i'm reading this piece on whether we should even bother with prompt tracking for AEO. it basically says we can't treat it like traditional rank tracking since everything is just probability now. the idea is that we aren't looking for absolute certainty, just a
probability of presence across topic clusters. sounds fine in theory but honestly feels like another way to justify vague metrics. if you aren't even trying to capture every possible question, how do you know when you're actually losing ground? it mentions focusing on intent space and entities rather than exact wording, which is basically just
guessing sampling. i don't see how this stays useful once the volatility gets too high to ignore. if we're only measuring frequency across repeated queries, aren't we just creating a new kind of vanity metric? feels like we're just trading one unstable signal for another. does anyone actually have a set of prompts that doesn't feel totally arbitrary?
https://www.seoclarity.net/blog/prompt-tracking-valid