Expand each heading to view my notes.
The aim is to understand
- What are foundational models? How are they trained?
- What is the current state of the art in ML?
- What are the capability requirements for an AI to be an AGI?
- Contrast modern ML with your blueprint for AGI and evaluate if and when it could be developed.
Progress of Language Models
Foundational Models
Four premises/claims behind MIRI’s mission
AGI Safety from first principles
Why and how of scaling LLMs
Future ML Systems will be qualitatively different
More is Different for AI