Glossary
AI Alignment
The process of ensuring that AI systems behave in ways that are consistent with human values and intentions.
AI Interpretability
The degree to which a model’s decision-making process can be understood by humans.
Adversarial prompting
Designing prompts to test or exploit vulnerabilities in AI models.
Agent Swarm
An experimental, educational framework for exploring ergonomic, lightweight multi-agent orchestration.
Attention mechanism
A technique that allows models to focus on different parts of the input when generating output.
Chain-of-thought prompting
Chain-of-thought prompting is a strategy that encourages an AI model to articulate its reasoning process step-by-step. This method often leads to more accurate and transparent decision-making.
Constitutional AI
Techniques to align AI models with specific values or principles through careful prompt design.
Constrained generation
Using prompts to limit the model’s output to specific formats or content types.
Context window
The maximum amount of text a model can process in a single prompt.
Cross-task generalization
The ability of a model to apply knowledge from one type of prompt to a different but related task.
Dynamic Agents
AI agents that can adapt their behavior and instructions based on context and previous interactions.
Embeddings
Dense vector representations of words, sentences, or other data types in a high-dimensional space.
Explainable AI
AI systems designed to provide clear explanations for their outputs or decisions.
Feature engineering
The process of selecting, modifying, or creating new features from raw data to improve the performance of machine learning models.
Federated learning
A machine learning technique that trains algorithms across multiple decentralized devices or servers holding local data samples.
Few-shot prompting
Few-shot prompting is a method that involves providing a small number of examples to guide an AI model's performance on a task.
Fine-tuning
The process of further training a pre-trained model on a specific dataset to adapt it to a particular task or domain.
Function Calling
Enabling AI models to call specific functions to perform tasks or retrieve information.
Generative Adversarial Networks (GANs)
A framework where two neural networks (a generator and a discriminator) compete against each other to create realistic data.
Gradient Descent
An optimization algorithm used to minimize the cost function in machine learning by iteratively updating the model parameters.
Hallucination (AI)
When an AI model generates false or nonsensical information that it presents as factual.
In-context learning
The model’s ability to adapt to new tasks based on information provided within the prompt.
Instruction tuning
Fine-tuning language models on datasets focused on instruction-following tasks.
Knowledge Distillation
A machine learning technique that aims to transfer the learnings of a large pre-trained model (the "teacher model") to a smaller "student model."