Notes on frontier ML. Papers, concepts, entities — structured for fast lookup and cross-referencing.

39 concepts · 28 sources · 13 entities


Recently Ingested


Concepts by Theme

Architecture Transformer · Attention · FlashAttention · Mamba · Positional Encoding · Vision Transformer · Early Fusion · Patch Embeddings

Training Scaling Laws · Grokking · Distillation · SFT · RLHF · DPO · PPO · Alignment · Contrastive Learning · Emergent Abilities · Phase Transition

Inference Speculative Decoding · KV Cache · Inference Efficiency · LoRA

Multimodal & Agents In-Context Learning · Chain-of-Thought · Tool Use · Zero-Shot Transfer · Visual Grounding · Open-Vocabulary Segmentation · Multimodal Embeddings · Diffusion Models · Video Generation


Entities

Albert Gu · Ashish Vaswani · Noam Shazeer · Tri Dao · OpenAI · Google DeepMind · Google Brain · Microsoft Research