Hacker Newsnew | past | comments | ask | show | jobs | submit | strandstan's commentslogin

Hi I'm Albert Zhao, one of the blog authors. Strands harness is meant to be deployed outside of AWS too. I got it running on Cloudflare Containers and Modal before this launch (deployment docs coming soon). We just want to keep making a really good harness, esp since Strands is born from a lot of internal headbanging around building agents


I believe that you just want to make a really good harness, but is that all amazon wants it to be or do they want more?


Yeah Strands powers thousands of agents at Amazon, so we all really benefit from being open source thanks to improvements/github issues from the community. Our focus is making agents run easily and reliably in prod


Correct the Strands team and I are a part of AWS, though all of our work is open source. We want folks to deploy Strands harness anywhere they want


The scores are in blog post's bar chart. For Terminal Bench 2.1, Strands harness (Fable 5) scored 69.7 while Claude Code (Fable 5) scored 61.8. This is on high effort.

I hear you tho about saturation. We're working on a follow-up deep dive post with more harnesses, so could look into Terminal Bench 4.0?


Then I'm really confused. Terminal Bench 2.1 scores on Artificial Analysis are like 80-90%. https://artificialanalysis.ai/evaluations/terminalbench-2-1


AA isn’t testing different harnesses there, they’re testing different models on the same common harness:

“We run Terminal-Bench 2.1 with the Terminus 2 agent harness in an e2b sandbox and report pass@1 averaged over 3 repeats per task.”

This is a different agent harness than those Strands was testing with, and there’s no guarantee the pass criteria matches up the same either.


hi Albert from the Strands team. We can look into a Pi run. Our researcher is working on a deep dive for our benchmarks, so we got resources to test against other harnesses


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: