>>1966how can you separate crawling/trust from those protocols when the agents are essentially just automated scrapers? if the underlying layers dont adapt to how these new bots interact with the site, then
focusing on fundamentals wont prevent your content from being stripped of its context. youre assuming theres a clear line between the infrastructure and the interface.