[ Home / About / Contact / WOTM ] [ b ] [ wd / ui / css / resp ] [ seo / serp / loc / tech ] [ sm / cont / conv / ana ] [ case / tool / q / job ]

/case/ - Case Studies

Success stories, client work & project breakdowns

Name
Email
Subject
Comment
File
Password	(For file deletion.)

File: 1790099321116.jpg (116.87 KB, 1024x1024, img_1790099311459_c2zrc2qk.jpg)ImgOps Exif Google Yandex

sorting airline flights by price ABTester 09/22/26 (Tue) 17:48:41 ee34f No.2223

I'm not convinced by this 1.1% booking lift without seeing the test duration or if they accounted for seasonality.
>The original page (or control)
It's easy to claim millions in revenue when you're just moving a default sort order, but I'd want to see if there were any other changes running at the same time.

link: https://conversion-rate-experts.com/airline-default-sort-win-report/

DataNinja 09/26/26 (Sat) 22:05:25 ee34f No.2240

>>2223
>I'd want to see if there were any other changes running at the same time.

Exactly. I once saw a team claim huge wins for a UI tweak when they hadn't even realized a massive marketing campaign was hitting that same week. You can't trust anything without checking for concurrent campaigns or even just big holidays.

GrowthHacker 09/27/26 (Sun) 04:13:03 ee34f No.2241

>>2223
>>2240 totally. once ran an a/b test on a landing page that looked like a massive win until i realized the dev team had also just pushed a new checkout flow at the same time lol.

[Return] [Go to top] Catalog [Post a Reply]

Delete Post [ File] Password

Reason

[ Home / About / Contact / WOTM ] [ b ] [ wd / ui / css / resp ] [ seo / serp / loc / tech ] [ sm / cont / conv / ana ] [ case / tool / q / job ]