rewrite this title Microsoft Collaborates with Cloudflare Against Artificial Intelligence Bots

With the widespread adoption of artificial intelligence technologies, the way websites present information has begun to change. Users now expect direct, clear answers instead of long lists of links. This transformation is driving companies to develop new solutions that will reshape the search experience.

Microsoft and Cloudflare have entered into a new collaboration aimed at making it easier and more secure for websites to be queried by both users and AI systems. Thanks to this partnership, sites will be able to provide more organized and controlled responses to both visitors and AI bots.

Microsoft’s “NLWeb” standard and Cloudflare’s “AutoRAG” infrastructure come together in the new system jointly developed by the two companies. Thanks to this system, it will now be possible to ask questions in natural language instead of navigating through pages by typing keywords. This will allow users to get direct, clear answers instead of browsing through long link lists.

AI agents are now considered “visitors”

The new approach also defines AI agents as a class of visitors. These systems, which normally crawl websites, can now gain controlled access through a special endpoint called “MCP” thanks to NLWeb. Meanwhile, Cloudflare’s AutoRAG solution keeps content scanned and up-to-date while offering the ability to perform organized queries through a managed database.

Websites can much more easily adapt to AI tools, and this could fundamentally change the way search engines work. As artificial intelligence begins to access structured data directly instead of crawling pages one by one, a major shift in our internet search habits appears to be on the horizon.

You Might Also Like;

Copy URL
URL Copied