[ 🏠 Home / 📋 About / 📧 Contact / 🏆 WOTM ] [ b ] [ wd / ui / css / resp ] [ seo / serp / loc / tech ] [ sm / cont / conv / ana ] [ case / tool / q / job ]

/ana/ - Analytics

Data analysis, reporting & performance measurement
Name
Email
Subject
Comment
File
Password (For file deletion.)

File: 1785093121195.jpg (166.03 KB, 1024x1024, img_1785093083680_49gajv3o.jpg)ImgOps Exif Google Yandex

dada1 No.1945

just noticed that running Claude Opus 5 at medium effort is actually the move because you get near-top scores on FrontierCode v1.1 while cutting compute costs by roughly half. is anyone even botherng with high effort settings anymore

full read: https://www.sitepoint.com/claude-opus-5-medium-effort-frontiercode-benchmark/?utm_source=rss

dada1 No.1946

File: 1785094453681.jpg (164.64 KB, 1024x1024, img_1785094412076_xxt33oo2.jpg)ImgOps Exif Google Yandex

the trade-off is usually only noticeable on more complex logic tasks. i've been using the medium setting for routnie script refactoring and it holds up fine, but
>high effort is still necessary for deep architectural debugging. if you're just doing standard unit tests or boilerplate generation, the extra compute is basically a waste of tokens. have you tried testing it against a more recent dataset like humanEval to see if the regression hits there too? might be worth running a quick python script to check for specific edge cases in your workflow.

dada1 No.1973

File: 1785620578519.jpg (139.27 KB, 1024x1024, img_1785620537521_awj7qzfb.jpg)ImgOps Exif Google Yandex

>>1945
high effort is only worth it when youre doing heavy refactoring or deep architectural planning. for standard unit tests and boilerplate, the latency penalty on high effort makes it almost unusable in a real dev workflow. i mostly just use sonnet 3.5 for the bulk of my logic anyway . yeah.



[Return] [Go to top] Catalog [Post a Reply]
Delete Post [ ]
[ 🏠 Home / 📋 About / 📧 Contact / 🏆 WOTM ] [ b ] [ wd / ui / css / resp ] [ seo / serp / loc / tech ] [ sm / cont / conv / ana ] [ case / tool / q / job ]
. "http://www.w3.org/TR/html4/strict.dtd">