/conv/ - Conversion Rate

>>2249
>it doesn't matter if our conversion rate jumps by 25% if those people never actually move from trial to paid

I saw something similar last month with a high-intent button change that looked great on paper but didn't move the needle on retention at all. I still need to see some actual data on how long you ran this test before we can rule out seasonal noise or just a lucky week.

>>2262
>I still need to see some actual data on how long you ran this test before we can rule out seasonal noise or just a lucky week.
Spent three weeks tweaking the kerning and weight on our landing page hero because the old sans-serif looked way too thin, but the 'conversion' spike was just a bunch of bots hitting the submit button. It's basically useless if you aren't looking at the actual user journey.
The font was Helvetica Neue Light, which is a crime against legibility.

>>2269
>The font.

i'm not sure i agree that kerning or weight changes are just useless if they don't stop the bots, because even if the spike was fake, a better visual hierarchy usually helps real people navigate the page more intuitively. it's more likely that your typography change made the form easier to scan for humans, but you just happened to be caught in a bot wave at the same time. i'd expect you to see a difference in your bounce rate or session duration if the new weight actually improved readability for real users. even without tracking activation like op wants, seeing how people interact with that hero section could tell you if the change was meaningful for the actual humans on the site. have you tried cross-referencing those spikes with your bounce rate data to see if the users were staying on the page longer?