ML Wiki

❯

Sources

Apr 05, 20261 min read

Ingested papers, blog posts, talks, and reports.

98 items under this folder.

May 09, 2026
C-Pack / BGE: Packed Resources for General Chinese Embeddings
May 09, 2026
CodeAct: Executable Code Actions Elicit Better LLM Agents
May 09, 2026
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
May 09, 2026
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning
May 09, 2026
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
May 09, 2026
Hidden Markov Map Matching Through Noise and Sparseness
May 09, 2026
LLaVA-1.5: Improved Baselines with Visual Instruction Tuning
May 09, 2026
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
May 09, 2026
MTEB: Massive Text Embedding Benchmark
May 09, 2026
On Calibration of Modern Neural Networks
May 09, 2026
Orca: A Distributed Serving System for Transformer-Based Generative Models
May 09, 2026
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
May 09, 2026
PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
May 09, 2026
Qwen2.5-VL Technical Report
May 09, 2026
SAM 2: Segment Anything in Images and Videos
May 09, 2026
SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery
May 09, 2026
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
May 09, 2026
t2vec: Deep Representation Learning for Trajectory Similarity Computation
May 09, 2026
Word2Vec: Efficient Estimation of Word Representations in Vector Space
May 09, 2026
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
May 08, 2026
Flamingo: A Visual Language Model for Few-Shot Learning
May 07, 2026
Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
May 05, 2026
Self-Rewarding Language Models
May 04, 2026
AWQ: Activation-Aware Weight Quantization for LLM Compression and Acceleration
May 04, 2026
Training Compute-Optimal Large Language Models (Chinchilla)
May 03, 2026
Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task (Othello-GPT)
May 02, 2026
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
Apr 30, 2026
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
Apr 29, 2026
ORPO: Monolithic Preference Optimization without Reference Model
Apr 28, 2026
Highly Accurate Protein Structure Prediction with AlphaFold
Apr 27, 2026
Gemini 1.5: Unlocking Multimodal Understanding Across Millions of Tokens of Context
Apr 26, 2026
BPE: Neural Machine Translation of Rare Words with Subword Units
Apr 25, 2026
Learning to Summarize from Human Feedback
Apr 24, 2026
Consensus Entropy: Harnessing Multi-VLM Agreement for Self-Verifying and Self-Improving OCR
Apr 24, 2026
Mixture of Depths: Dynamically Allocating Compute in Transformer LLMs
Apr 23, 2026
DINOv2: Learning Robust Visual Features without Supervision
Apr 22, 2026
Distilling the Knowledge in a Neural Network
Apr 22, 2026
KTO: Model Alignment as Prospect Theoretic Optimization
Apr 21, 2026
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Apr 21, 2026
GPT-4 Technical Report
Apr 20, 2026
BART: Denoising Sequence-to-Sequence Pre-training
Apr 20, 2026
GQA: Grouped-Query Attention — How Modern LLMs Got 5x Faster Without Losing Quality
Apr 19, 2026
Deep Residual Learning for Image Recognition
Apr 18, 2026
Evaluating Large Language Models Trained on Code (Codex)
Apr 18, 2026
Scalable Diffusion Models with Transformers
Apr 18, 2026
Mistral 7B
Apr 17, 2026
Constitutional AI: Teaching Models to Self-Correct
Apr 17, 2026
Emerging Properties in Self-Supervised Vision Transformers (DINO)
Apr 17, 2026
KTO: Model Alignment as Prospect Theoretic Optimization
Apr 17, 2026
Language Models are Unsupervised Multitask Learners
Apr 17, 2026
High-Resolution Image Synthesis with Latent Diffusion Models
Apr 17, 2026
LIMA: Less Is More for Alignment
Apr 17, 2026
Llama 2: Open Foundation and Fine-Tuned Chat Models
Apr 17, 2026
Masked Autoencoders Are Scalable Vision Learners
Apr 17, 2026
Proximal Policy Optimization Algorithms
Apr 17, 2026
QLoRA: Efficient Finetuning of Quantized LLMs
Apr 17, 2026
Self-Consistency Improves Chain of Thought Reasoning in Language Models
Apr 17, 2026
SimCLR: A Simple Framework for Contrastive Learning of Visual Representations
Apr 17, 2026
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (T5)
Apr 17, 2026
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Apr 16, 2026
Denoising Diffusion Probabilistic Models
Apr 16, 2026
DeepSeek-R1: Incentivizing Reasoning via Reinforcement Learning
Apr 16, 2026
GRPO: Group Relative Policy Optimization (DeepSeekMath)
Apr 16, 2026
LLaVA: Visual Instruction Tuning
Apr 16, 2026
RAG: Retrieval-Augmented Generation for Knowledge-Intensive NLP
Apr 16, 2026
ReAct: Synergizing Reasoning and Acting in Language Models
Apr 16, 2026
Segment Anything - explained
Apr 16, 2026
Switch Transformers: Scaling to Trillion Parameter Models with Sparse MoE
Apr 16, 2026
Toolformer: Language Models Can Teach Themselves to Use Tools
Apr 16, 2026
Whisper: Robust Speech Recognition via Large-Scale Weak Supervision
Apr 15, 2026
Scaling Laws for Neural Language Models - explained
Apr 14, 2026
Adam: the optimizer that adapts — explained
Apr 13, 2026
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Apr 12, 2026
Splitwise: LLM Inference at Half the Cost by Splitting Prompt and Decode
Apr 11, 2026
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Apr 10, 2026
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Apr 10, 2026
Language Models are Few-Shot Learners
Apr 10, 2026
LLaMA: Open and Efficient Foundation Language Models
Apr 10, 2026
Act Wisely: Cultivating Meta-Cognitive Tool Use in Agentic Multimodal Models (Metis / HDPO)
Apr 10, 2026
Mixtral of Experts
Apr 10, 2026
Neural Computers
Apr 10, 2026
NUMINA: When Numbers Speak — Aligning Textual Numerals and Visual Instances in Text-to-Video Diffusion Models
Apr 10, 2026
Scaling Laws for Neural Language Models
Apr 10, 2026
Training language models to follow instructions with human feedback (InstructGPT)
Apr 09, 2026
CLIP: Learning Transferable Visual Models From Natural Language Supervision
Apr 08, 2026
Emergent Abilities of Large Language Models
Apr 06, 2026
RoPE: Enhanced Transformer with Rotary Position Embedding
Apr 05, 2026
Attention Is All You Need
Apr 05, 2026
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Apr 05, 2026
Falcon Perception: Early-Fusion Transformer for Open-Vocabulary Grounding and Segmentation
Apr 05, 2026
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Apr 05, 2026
Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets
Apr 05, 2026
A Systematic Empirical Study of Grokking: Depth, Architecture, Activation, and Regularization
Apr 05, 2026
LoRA: Low-Rank Adaptation of Large Language Models
Apr 05, 2026
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Apr 05, 2026
Efficient Memory Management for Large Language Model Serving with PagedAttention
Apr 05, 2026
Fast Inference from Transformers via Speculative Decoding
Apr 04, 2026
Direct Preference Optimization: Your Language Model is Secretly a Reward Model