ML Wiki

❯

Concepts

Apr 05, 20261 min read

Recurring ideas, techniques, and phenomena referenced across sources.

120 items under this folder.

May 09, 2026
Benchmark
May 09, 2026
Bi-Encoder
May 09, 2026
Calibration
May 09, 2026
Data Parallel
May 09, 2026
Distributed Training
May 09, 2026
Distributional Hypothesis
May 09, 2026
Evaluation
May 09, 2026
Expected Calibration Error (ECE)
May 09, 2026
Geospatial Foundation Models
May 09, 2026
Hidden Markov Models
May 09, 2026
Isotonic Regression
May 09, 2026
Late Interaction
May 09, 2026
Map Matching
May 09, 2026
Masked Image Modeling
May 09, 2026
Mixed Precision Training
May 09, 2026
Model Parallel
May 09, 2026
Negative Sampling
May 09, 2026
Semantic Similarity
May 09, 2026
Sentence Embeddings
May 09, 2026
Siamese Networks
May 09, 2026
Tensor Parallel
May 09, 2026
Trajectory Embeddings
May 09, 2026
Viterbi Algorithm
May 09, 2026
Word Embeddings
May 08, 2026
Perceiver Resampler
May 04, 2026
Quantization
May 03, 2026
Mechanistic Interpretability
May 03, 2026
Probing (Neural Network Interpretability)
Apr 28, 2026
Evoformer
Apr 28, 2026
Protein Structure Prediction
Apr 27, 2026
Long Context
Apr 26, 2026
Subword Units
Apr 26, 2026
Tokenization
Apr 26, 2026
Vocabulary
Apr 24, 2026
Dynamic Computation
Apr 24, 2026
Self-Consistency
Apr 24, 2026
Uncertainty Estimation
Apr 24, 2026
Vision-Language Models (VLMs)
Apr 22, 2026
Model Compression
Apr 22, 2026
Ensemble Methods
Apr 22, 2026
Temperature Scaling
Apr 21, 2026
optimization
Apr 20, 2026
Denoising
Apr 19, 2026
Batch Normalization
Apr 19, 2026
Residual Connections
Apr 19, 2026
Vanishing Gradients
Apr 18, 2026
Code Generation
Apr 18, 2026
Grouped Query Attention (GQA)
Apr 18, 2026
Sliding Window Attention (SWA)
Apr 17, 2026
AI Feedback (RLAIF)
Apr 17, 2026
Constitutional AI (CAI)
Apr 17, 2026
Cross-Attention
Apr 17, 2026
Data Augmentation
Apr 17, 2026
Data Quality
Apr 17, 2026
Encoder-Decoder
Apr 17, 2026
Harmlessness (AI alignment)
Apr 17, 2026
Instruction Following
Apr 17, 2026
Latent Space
Apr 17, 2026
Memory Efficiency
Apr 17, 2026
Policy Gradient
Apr 17, 2026
Reinforcement Learning
Apr 17, 2026
Sampling
Apr 17, 2026
Self-Critique (AI)
Apr 17, 2026
Self-Supervised Learning
Apr 17, 2026
Variational Autoencoder (VAE)
Apr 16, 2026
Foundation Models
Apr 16, 2026
GRPO (Group Relative Policy Optimization)
Apr 16, 2026
Mixture of Experts (MoE)
Apr 16, 2026
Multimodal Instruction Tuning (Visual Instruction Tuning / VLMs)
Apr 16, 2026
Promptable Segmentation
Apr 16, 2026
RAG (Retrieval-Augmented Generation)
Apr 16, 2026
RL for Reasoning (Test-Time Compute Scaling)
Apr 15, 2026
Compute-Optimal Training
Apr 15, 2026
Power Laws
Apr 14, 2026
adaptive-learning-rate
Apr 14, 2026
bias-correction
Apr 14, 2026
momentum
Apr 14, 2026
stochastic-gradient-descent
Apr 13, 2026
Bidirectional Context
Apr 13, 2026
Fine-tuning
Apr 13, 2026
Masked Language Model
Apr 13, 2026
Pre-training
Apr 12, 2026
Continuous Batching
Apr 11, 2026
Classification Token (CLS Token)
Apr 11, 2026
Inductive Bias
Apr 11, 2026
Patch Embeddings
Apr 11, 2026
Transfer Learning
Apr 10, 2026
Alignment (AI)
Apr 10, 2026
Contrastive Learning
Apr 10, 2026
Diffusion Models
Apr 10, 2026
Emergent Behavior (LLMs)
Apr 10, 2026
Multimodal Embeddings
Apr 10, 2026
Phase Transition (ML)
Apr 10, 2026
PPO (Proximal Policy Optimization)
Apr 10, 2026
Reward Model
Apr 10, 2026
Scaling Laws
Apr 10, 2026
Tool Use in Language Agents
Apr 10, 2026
Video Generation (Diffusion-Based)
Apr 10, 2026
Vision Transformer (ViT)
Apr 10, 2026
Zero-Shot Transfer
Apr 05, 2026
Attention (Multi-Head Self-Attention)
- concept
- architecture
Apr 05, 2026
Chain-of-Thought (CoT) Prompting
Apr 05, 2026
Early Fusion
Apr 05, 2026
Emergent Abilities
- concept
- scaling
Apr 05, 2026
FlashAttention
Apr 05, 2026
Grokking
Apr 05, 2026
In-Context Learning (ICL)
- concept
- prompting
Apr 05, 2026
Inference Efficiency
Apr 05, 2026
KV Cache
- concept
- inference-efficiency
Apr 05, 2026
LoRA (Low-Rank Adaptation)
Apr 05, 2026
Open-Vocabulary Segmentation
Apr 05, 2026
Positional Encoding
- concept
- architecture
Apr 05, 2026
Speculative Decoding
Apr 05, 2026
SSM / Mamba (State Space Models)
Apr 05, 2026
Transformer
- concept
- architecture
Apr 05, 2026
Visual Grounding
Apr 04, 2026
Distillation (Knowledge Distillation)
Apr 04, 2026
DPO (Direct Preference Optimization)
Apr 04, 2026
RLHF (Reinforcement Learning from Human Feedback)
Apr 04, 2026
SFT (Supervised Fine-Tuning)