Multimodal

How it is used

Used before nouns: multimodal model, multimodal input, multimodal search. Each type of data is called a modality. Many current LLMs are multimodal and accept images and audio as well as text.

Example sentences

1. With a multimodal model, technicians can photograph a broken part and ask what it is.

2. Our search is now multimodal: users can search with text or with an image.

Common collocations

• multimodal model
• multimodal input
• multimodal search
• multimodal LLM

Related terms

• LLMShort for large language model: a very large neural network trained on huge amounts of text to predict the next token, which lets it answer questions, write, summarize and code.
• computer visionThe area of AI that teaches computers to understand images and video, for example recognizing objects, reading text in photos or tracking movement.
• generative AIAI systems that create new content, such as text, images, audio, video or code, instead of only sorting inputs into classes or predicting values.
• embeddingA list of numbers (a vector) that represents a word, sentence, image or other item in such a way that items with similar meanings end up close to each other.

This word in other fields

The same English word can have a different meaning in another field:

• multimodal · Artificial Intelligence & Machine Learning

More terms: Machine Learning and Data Processing

• artificial intelligence
• machine learning
• model
• dataset
• training data
• label
• train
• supervised learning
• neural network
• deep learning
• loss function
• overfitting