Find the term.
See how it fits.
Explore the concepts behind AI agents, one useful connection at a time.
Concept directory
Inference
Inference is using an already trained model to produce an output from an input. For a text-generating language model, this usually means processing a prompt and generating tokens in sequence.
Language Model
A language model learns patterns in language and uses supplied context to produce a response. In an agent application, it can propose the next action; surrounding software carries out that action.
Mixture of Experts
A mixture-of-experts model uses multiple internal expert networks and a routing mechanism. In a sparse language-model implementation, the router sends each token through only a subset of those experts.
Multimodal Model
A multimodal model works with more than one kind of information, such as images and text. Which combinations it accepts or produces depend on the particular model.
Token
A token is a unit that a tokenizer turns into an identifier for a model to process. In text models it may represent a word, part of a word, punctuation, or another text fragment.