LLMs reward expertise(seangoedecke.com)
1041 points by MaxMussio 15 hours ago | 442 comments
tl;dr: Domain expertise dramatically amplifies the value you get from LLMs: Terence Tao's ChatGPT conversation on the Jacobian Conjecture shows how an expert can steer the model into concise, high-level output and extract insights a novice couldn't, by pushing back, redirecting, and recognizing what looks wrong. The same applies to programming—familiarity with your codebase lets you challenge the model's suggestions productively. This suggests human expertise remains valuable even as models improve, because the bottleneck is often communicating precisely what solution you want.
HN Discussion:
  • Non-experts struggle with LLMs because they can't recognize or correct wrong outputs
  • Prompting is a conditioning process that narrows the LLM into your domain knowledge space
  • ~Chat interfaces inherently disadvantage non-experts; browse-style UIs would help novices more
  • Signaling expertise or adding domain-specific keywords in prompts dramatically improves LLM output quality
  • ~The expertise claim needs formal study since low-effort prompts also seem to yield results