Tag: pre-training

May 09, 2026

• source
• distributed-training
• model-parallel
• tensor-parallel
• pre-training
• systems

May 04, 2026

• source
• scaling
• compute-optimal-training
• scaling-laws
• pre-training
• chinchilla

Apr 30, 2026

• source
• vision-language
• multimodal
• pre-training
• contrastive-learning

Apr 20, 2026

• concept
• pre-training
• self-supervised-learning

Apr 20, 2026

• source
• encoder-decoder
• pre-training
• denoising
• fine-tuning
• masked-language-model

Apr 18, 2026

• source
• code-generation
• pre-training
• fine-tuning
• sampling
• scaling-laws

Apr 17, 2026

• source
• pre-training
• language-model
• zero-shot
• gpt-2
• scaling
• multitask

Apr 17, 2026

• source
• pre-training
• rlhf
• sft
• gqa
• alignment
• llm
• meta-ai

Apr 17, 2026

• source
• self-supervised-learning
• vision-transformer
• pre-training
• masked-language-model
• patch-embeddings

Apr 17, 2026

• source
• transfer-learning
• pre-training
• encoder-decoder
• fine-tuning
• scaling-laws
• nlp

Apr 13, 2026

• concept
• transformers
• pre-training
• nlp

Apr 13, 2026

• source
• transformers
• attention
• pre-training
• nlp