{"id":2317,"date":"2026-09-15T18:52:58","date_gmt":"2026-09-15T17:52:58","guid":{"rendered":"https:\/\/www.bijt.org\/wordpress\/?p=2317"},"modified":"2026-09-15T18:52:58","modified_gmt":"2026-09-15T17:52:58","slug":"about-testing-ai-in-cyber-physical-settings","status":"publish","type":"post","link":"https:\/\/www.bijt.org\/wordpress\/2026\/09\/15\/about-testing-ai-in-cyber-physical-settings\/","title":{"rendered":"About testing AI in cyber-physical settings"},"content":{"rendered":"\n

IEEE has an article<\/a> on real-world testing of AI systems \u2018in the wild\u2019. An interesting new development in cyber-physical systems<\/a>.<\/strong><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

The article describes some of the experiments run \u201cby Andon Labs<\/a>, an AI safety<\/a> company based in San Francisco that puts AI agents<\/a> in charge of real-world operations and watches what happens.\u201d These experiments take place in physical urban spaces like consumer retail shops, caf\u00e9s, radio studios, etc. Here, AI agents created by e.g. Anthropic, Google<\/a>, and OpenA<\/a>I have to manage that specific situation. They often fail spectacularly: \u201cTheir spectacular and absurd failures have won the company plenty of attention.\u201d<\/p>\n\n\n\n

Why interesting? First, AI agents are is an interesting new direction for \u2018cyber-physical systems\u2019 to be deployed in actual urban settings.<\/p>\n\n\n\n

Second, real-world testing can be seen as a kind of (corporate) storytelling about emergent proof-of-concept technologies. Such real-world tests beyond the lab allow people to start imagining these technologies in their everyday lives. I\u2019m thinking of the work by Noortje Marres on self-driving cars<\/a>.<\/p>\n\n\n\n

Third, these kind of quotes bug me a lot, since it talks about human apprehensions and dislikes as some kind of barrier to be overcome, instead of speaking to inherent fallacies built into the so-called \u2018impressive\u2019 AIs: \u201cA real store can reveal [\u2026] whether customers want to shop at an AI-run business (the early results on that last point are decidedly negative). Such social and organizational barriers may help explain why impressive AI capabilities haven\u2019t yet translated into widespread adoption across the economy.\u201d Come on, the problem isn\u2019t people, the problem is tech and its makers!<\/p>\n\n\n\n

<\/p>\n\n\n\n

Link to original article >><\/a><\/p>\n

<\/div>","protected":false},"excerpt":{"rendered":"

IEEE has an article on real-world testing of AI systems \u2018in the wild\u2019. An interesting new development in cyber-physical systems. The article describes some of […] Read More<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":2316,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"mf2_syndication":[],"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false,"_share_on_mastodon":"0"},"categories":[16],"tags":[421,422,340],"class_list":["post-2317","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-cyber-physical","tag-testing-in-the-wild","tag-urban-ai"],"share_on_mastodon":{"url":"https:\/\/sciences.social\/@mdelange\/117276398572905168","error":""},"jetpack_publicize_connections":[],"jetpack_shortlink":"https:\/\/wp.me\/peQgW-Bn","jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/www.bijt.org\/wordpress\/wp-content\/uploads\/2026\/09\/img_3459.jpeg","_links":{"self":[{"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/posts\/2317","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/comments?post=2317"}],"version-history":[{"count":4,"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/posts\/2317\/revisions"}],"predecessor-version":[{"id":2321,"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/posts\/2317\/revisions\/2321"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/media\/2316"}],"wp:attachment":[{"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/media?parent=2317"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/categories?post=2317"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bijt.org\/wordpress\/wp-json\/wp\/v2\/tags?post=2317"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}