Cloudflare splits AI crawling, Meta eases WhatsApp: Sept. 16

Website owners can now tell major AI companies to keep their content out of model training without disappearing from traditional search. That is the day's biggest shift for any business that depends on Google or Bing traffic. Meta also shortened WhatsApp setup, while Google pushed new voice AI into Search and exposed how heavily websites load pages with ads.

Cloudflare separates search visibility from AI training

Cloudflare gave website owners a cleaner choice on September 15: stay visible in search while refusing AI model training. Its new Disallow AI Training setting publishes the site's preference in robots.txt, the file that gives automated visitors instructions, and blocks training crawlers that ignore it.

The distinction matters because some crawlers serve more than one purpose. Googlebot, Bingbot, and Applebot can collect pages for search as well as AI uses. A blanket block can therefore remove a business from search results. Cloudflare says Apple, Google, and Microsoft either honor or have committed to honor the narrower preference, though Microsoft's full domain-level support is targeted for early 2027.

For most existing Cloudflare customers, settings migrate automatically. Still, this deserves a manual check. Businesses that want discovery should usually keep search crawling open. Publishers with costly original material have a stronger reason to refuse training. Our earlier brief on charging AI crawlers covers the related question of paid access, while the AI search traffic guide explains why visibility can matter even when fewer people click.

Meta hands WhatsApp setup work to AI agents

Meta launched WhatsApp Business Tools MCP on September 15, letting supported AI coding agents create accounts, register phone numbers, build message templates, and test connections. MCP, short for Model Context Protocol, is a standard that lets an AI assistant work with outside software under defined permissions.

The official Meta announcement says the tool checks common setup failures such as unsigned terms, a missing payment method, or incomplete business verification. Changes still require an authenticated person, and Meta says access is rolling out gradually. It is built for setup and testing, not sending customer messages at scale.

That boundary is important. A business can reduce the technical work needed to start WhatsApp messaging, but it still needs someone to approve templates, protect customer data, and test what happens when a message fails. Owners already reviewing customer systems can use the access checklist in our marketing software audit.

Google makes voice search more capable

Google released Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking on September 15. The first model is now powering Search Live, Google's spoken, back-and-forth search experience. The second spends more computing time on complicated requests.

According to Google's launch post, Search Live users get more natural conversations, multilingual switching, and answers with web links. This gives customers another way to compare businesses without typing a neat keyword into a search box.

Local operators should test spoken questions that describe a need instead of naming a company. Listen for which details the answer repeats: service area, availability, price, reviews, or something else. Then make those facts explicit on the site and business profiles. Our guide to AI recommendations explains the signals assistants use when selecting companies.

Chrome measures how much advertising fills a page

Chrome added four experimental measurements on September 15 for sites that carry third-party ads: ad count, screen area covered, data downloaded, and processing time. The Chrome announcement says the data comes from the Chrome User Experience Report, which summarizes how real visitors experience websites.

There are no pass or fail targets yet, and these measurements do not affect Google's existing page-experience scores. They do give publishers and advertisers a shared way to spot pages where ads crowd the content or slow the browser. If your company buys display ads, ask where placements sit on these measures before treating a cheap impression as good value. If your site sells ads, check the data before adding another slot.

Worth watching

• Cloudflare plans finer controls for how much site content can appear inside AI summaries by early 2027.
• Meta's WhatsApp setup tool is still rolling out, so availability may differ between business accounts.
• Chrome expects coverage for its experimental ad measurements to increase over the next month.