Small Models Have Arrived(calv.info)
786 points by tosh 14 days ago | 345 comments
tl;dr: Small, fast models like "gpt-5.6-luna" and GLM 5.3 have become capable enough to handle complex tasks (research, personalized news aggregation) at costs around $0.10 instead of $1+, potentially unlocking consumer AI apps that were previously uneconomical due to token costs. The author argues that while frontier models will remain essential for "IQ 180" novel problem-solving, most business work is "token spewer" grunt work—responsiveness, follow-ups, coordination—where cheap/good-enough models could soon dominate, pending advances in harnesses, safety, and permissions.
HN Discussion:
  • Small models were already good enough for most tasks; frontier chasers are late to realize this
  • Small models enable exciting local/on-device AI in home gadgets and personal hardware
  • Skeptical about consumer AI opportunities since frontier labs will dominate the space
  • Room-at-the-bottom strategies make sense since many apps don't need world knowledge stored in huge models
  • ~Developers/users may resist downgrading to cheaper models due to quality concerns