ML Wiki

Tag: memory-efficiency

6 items with this tag.

  • May 09, 2026

    Mixed Precision Training

    • concept
    • training
    • numerical-precision
    • memory-efficiency
  • May 09, 2026

    GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

    • source
    • quantization
    • inference-efficiency
    • memory-efficiency
    • compression
  • May 09, 2026

    PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

    • source
    • distributed-training
    • fsdp
    • data-parallel
    • pytorch
    • memory-efficiency
    • systems
  • May 09, 2026

    ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

    • source
    • distributed-training
    • memory-efficiency
    • data-parallel
    • model-parallel
    • deepspeed
  • May 04, 2026

    AWQ: Activation-Aware Weight Quantization for LLM Compression and Acceleration

    • source
    • quantization
    • inference-efficiency
    • memory-efficiency
    • compression
  • Apr 17, 2026

    QLoRA: Efficient Finetuning of Quantized LLMs

    • source
    • quantization
    • lora
    • fine-tuning
    • memory-efficiency
    • inference-efficiency