Batch processing

How it is used

The opposite is stream processing, or real-time processing. Batch jobs run on a schedule, and people talk about the 'nightly batch' or 'daily batch'. Most reporting dashboards rely on batch processing, so their data is a few hours old.

Example sentences

1. We use batch processing for finance reports because they only need daily numbers.

2. With batch processing, today's orders won't show up until tomorrow morning.

Common collocations

• nightly batch
• batch job
• batch processing pipeline
• batch versus streaming

Related terms

• data pipelineA series of automated steps that moves data from its sources, transforms it and delivers it to a destination such as a warehouse, dashboard or model.
• ETLShort for extract, transform, load: the process of taking data out of source systems, cleaning and reshaping it, and loading it into a warehouse.
• data warehouseA central database built for reporting and analysis that collects historical data from many systems and is designed for large read queries rather than small updates.
• data lakeA large storage system that holds huge amounts of raw data in its original format, structured or not, until someone needs to process and analyse it.

This word in other fields

The same English word can have a different meaning in another field:

• batch processing · Data Science & Analytics

More terms: Machine Learning and Data Processing

• artificial intelligence
• machine learning
• model
• dataset
• training data
• label
• train
• supervised learning
• neural network
• deep learning
• loss function
• overfitting