Amazon saves millions by replacing Sonnet 4.6 with Strands Decider(strandsagents.com)
696 points by aloukissas 1 day ago | 244 comments
tl;dr: Amazon replaced Claude Sonnet 4.6 with Strands Decider E4B (a Gemma-based decision model that outputs probabilities over fixed options rather than text) for labeling internal tickets, cutting costs ~98% (~$22,200 to ~$500 per million tickets) while improving accuracy and latency by 78%. The team ran both models in parallel via an AppConfig switch to validate before cutover. The approach works when classification is a closed-choice problem with a stable catalog and context that fits in a few thousand tokens; one gotcha was that JSON key order affected output probabilities by up to 0.19.
HN Discussion:
  • ↑The field is cyclically returning to classical ML classifiers after over-relying on LLMs
  • ↓Questions why Amazon didn't try cheaper alternatives like Haiku or build in-house first
  • ↓The article is confusing or poorly explained regarding the model naming and approach
  • ~Concerns about JSON key order affecting probabilities being a serious flaw
  • •Verifies and contextualizes the scale of tickets needed to justify the claimed savings