Official Technical Resources: NVIDIA (page 5)
Official Technical Resources · NVIDIA: 264 entries in total; this page lists entries 61–75.
dLLM Fine-Tuning
Fine-tune diffusion language models (dLLMs), including LLaDA, DiffusionGemma, DFlash, and I-DLM, with NeMo AutoModel.
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Fine-tuning · Distributed Training and Parallelism Strategies · Pre-training
Link last checked: 2026-09-25
Knowledge Distillation with NeMo AutoModel
This guide walks through fine-tuning a student LLM with the help of a larger teacher model using the kd (knowledge distillation) recipe.
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Fine-tuning · Distributed Training and Parallelism Strategies · Pre-training
Link last checked: 2026-09-25
Fine-Tune Large MoE LLMs
Mixture-of-Experts (MoE) architectures have become the dominant design for frontier language models, activating only a fraction of their total parameters per…
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Fine-tuning · Distributed Training and Parallelism Strategies · Pre-training
Link last checked: 2026-09-25
Pretrain Megatron Core Datasets with NeMo AutoModel
Pretraining builds a base large language model (LLM) by training a randomly initialized model to predict the next token across massive, unlabeled datasets.
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Fine-tuning · Distributed Training and Parallelism Strategies · Pre-training
Link last checked: 2026-09-25
Quantization-Aware Training (QAT) in NeMo Automodel
NeMo Automodel supports Quantization-Aware Training (QAT) for Supervised Fine-Tuning (SFT) using TorchAO.
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Fine-tuning · Distributed Training and Parallelism Strategies · Pre-training
Link last checked: 2026-09-25
Retrieval Fine-Tuning (Bi-Encoder and Cross-Encoder)
Fine-tune bi-encoder and cross-encoder retrieval models in NeMo AutoModel with distributed training, low-rank adaptation (LoRA), hard-negative mining, and evaluation.
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Fine-tuning · Distributed Training and Parallelism Strategies · Pre-training
Link last checked: 2026-09-25
Supervised Fine-Tuning (SFT) and Parameter-Efficient Fine-Tuning (PEFT) with NeMo AutoModel
Fine-tune language models with NeMo AutoModel using SFT or PEFT (LoRA), from install and YAML config through training, evaluation, publish, and vLLM deploy.
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Fine-tuning · Distributed Training and Parallelism Strategies · Pre-training
Link last checked: 2026-09-25
Audio Curation Pipeline (Overview)
Modality-level overview of ingest, validation, optional ASR, metrics, filtering, and export
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Pre-training · Model Evaluation and Benchmarks · Multimodal Models
Link last checked: 2026-09-25
Audio Quality Metrics
Core concepts for evaluating speech transcription quality using WER, CER, duration analysis, and speech rate metrics
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Pre-training · Model Evaluation and Benchmarks · Multimodal Models
Link last checked: 2026-09-25
Deduplication Concepts
Comprehensive overview of deduplication techniques across text, image, and video modalities including exact, fuzzy, and semantic approaches
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Pre-training · Model Evaluation and Benchmarks · Multimodal Models
Link last checked: 2026-09-25
Image Curation Concepts
Essential concepts for image data curation including loading, processing, and export with GPU acceleration
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Pre-training · Model Evaluation and Benchmarks · Multimodal Models
Link last checked: 2026-09-25
Auto-Balancing Heterogeneous Models
How NeMo Curator automatically balances resources across pipeline stages
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Pre-training · Model Evaluation and Benchmarks · Multimodal Models
Link last checked: 2026-09-25
Scaling Up with Ray Resource Allocation
How NeMo Curator allocates CPUs, GPUs, and memory across pipeline stages
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Pre-training · Model Evaluation and Benchmarks · Multimodal Models
Link last checked: 2026-09-25
Streaming vs. Batch Processing
How NeMo Curator's streaming architecture processes data in constant memory
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Pre-training · Model Evaluation and Benchmarks · Multimodal Models
Link last checked: 2026-09-25
Maximizing Throughput
How to scale NeMo Curator from a single GPU to multi-node clusters for maximum throughput
Evidence use: For understanding GPU computing, training, retrieval, inference serving, reliability or deployment decisions.
Limitations: Directly evidences only the implementation and claims of NVIDIA's technology stack. Recheck versioned interfaces and experimental capabilities before use.
Related concepts: Pre-training · Model Evaluation and Benchmarks · Multimodal Models
Link last checked: 2026-09-25