I were 17, I'd learn how to build LLMs from scratch

	I were 17, I'd learn how to build LLMs from scratch(twitter.com)
	605 points by bilsbie 63 days ago \| 681 comments
	tl;dr: Summary not available.
	HN Discussion: ↑Learning cutting-edge tech as a young person is a valuable tradition worth encouraging ↑Understanding LLM fundamentals builds intuition for future problems and knowing when not to use them ↓Advice is outdated; LLM jobs require proprietary infra and knowledge is already commoditized ↓Autoregressive LLMs will become dated; broader foundational ML knowledge is more valuable ~Learning resources and hardware barriers make this advice difficult to follow in practice