/tool/ - Tools & Resources

heard they released a new benchmark called automationbench? i think it's pretty cool because instead of just testing ai models on academic problems like math or coding puzzles (which are all well and good), this one actually looks at whether an llm can handle real business tasks. kinda neat, right?

i wonder how our favorite llms will fare. do you have a go-to model that might struggle with practical workflows?

full read: https://zapier.com/blog/introducing-automationbench