AI & ML Glossary
Plain-English definitions for technical terms, with links to the papers where they appear.
A
- Ablation study (20)
- Agent (60)
- Alignment (60)
- Attention mechanism (63)
B
- Benchmark (60)
C
- Chain of thought (29)
- Context window (5)
- Convolutional neural network (4)
- Cross-attention (15)
- Cross-modal (2)
- Curriculum learning (2)
D
- Diffusion model (15)
- Distillation (49)
E
- Embeddings (40)
- Embodied AI
- Emergent (3)
- Ensemble
F
- Fine-tuning (143)
- Flow matching (15)
G
H
- Hallucination (21)
- Held-out set
- Hyperparameter (3)
I
- Image segmentation (2)
- Imitation learning (3)
- In-context learning (21)
- Inference (60)
J
- Jailbreak (5)
K
- KV cache (22)
L
- Large language model (173)
- Latent space (11)
- LoRA (29)
M
- Mixture of experts (25)
- Multi-agent system (4)
- Multimodal (60)
N
- Neural network (15)
O
- On-policy distillation (17)
- Orchestration (3)
- Out-of-distribution (4)
- Overfitting (3)
P
- Parameters (9)
- Pass@k
- Policy (45)
- Policy gradient
- Policy network
- Power law (3)
- PPO (2)
- Precision (2)
- Pretraining (14)
- Prompt injection (8)
Q
- Quantization (22)
R
- Recall (4)
- Red teaming
- Reinforcement learning (72)
- Retrieval-augmented generation (36)
- Reward hacking (7)
- Reward model (6)
- Reward signal
- RLHF (6)
- Router (15)
S
T
- Test-time scaling (9)
- Token (38)
- Tool use (7)
- Trajectory (39)
- Transformer (75)
- Tree of thoughts
V
W
- World model (19)
Z
- Zero-shot (26)