another day of chasing googlebot around. read this bit about using ai to fix indexing issues on some tolkien art site. apparently just pumping stuff into social media helps crawl the pages.
>When you launched your website. there's something i recently realized that's made the frustration of this serious issue a little bit easier to live with.sounds like a massive waste of time if you actually have a real crawling problem. it's basically just hoping some bot hits a link and tells google we exist. using ai for this feels like adding more bloat to an already broken system. i don't see how social signals fix a legitimate sitemap or robots.txt error. if the crawler isn't hitting the url, a few tweets aren't going to save your rankings. seems like a lot of extra work for zero actual control over the index. just another way to pretend we can bypass google's shitty behavior with magic tools.
https://whitespark.ca/blog/how-to-overcome-google-indexing-problems-with-social-media-ai/