The next hurdle for AI agents: getting websites to let them in
techcrunch ·
Personal AI agents like Meta’s Muse are facing significant barriers as numerous websites block their access, disrupting tasks such as booking flights and making purchases. While some blocks are intentional measures against unauthorized automation, others result from traditional anti-bot systems that inadvertently reject legitimate agent traffic. For instance, Amazon has explicitly blocked Muse, whereas Walmart’s issues stem from human verification challenges rather than a deliberate ban. In response to this growing friction, major industry players including Meta, Stripe, and Walmart are collaborating on an open standard to facilitate secure agent-to-agent communication for commerce. Despite these efforts, many brands like Delta, United, Yelp, and eBay maintain restrictive policies or lack clear integration pathways for third-party AI agents. This ambiguity leaves consumers frustrated when their agents fail to complete transactions, often mistaking technical blocks for service refusals. Cloudflare’s recent changes to crawler defaults have further complicated the landscape by potentially blocking AI training bots alongside malicious ones. Ultimately, the industry is moving toward formal partnerships and standardized protocols to distinguish beneficial agents from spam while protecting business interests.
techcrunch