AI Jargon Buster
AI news and the language around it, simplified.
What is Compute Overhead?
Compute overhead refers to the extra computing power, electricity, and time required to run AI software beyond the actual task it performs. When an AI system processes a request, it must also handle background tasks like security checks, data formatting, and system maintenance. These secondary processes consume resources that do not directly produce the final result but are necessary for the system to function reliably. Think of it like the fuel a car burns just to keep the engine idling at a stoplight. It is a hidden cost that grows as more people use the software, and it is a major factor in the total price of maintaining an AI project.
Why this matters to you
Ignoring compute overhead leads to significant budget surprises. As your team scales an AI tool from a small pilot to a company-wide rollout, these hidden costs can multiply quickly and make a project much more expensive than your initial estimates suggested.
How you might hear this
The compute overhead for this feature is quite high because it requires constant data synchronization across our entire cloud network.
AI Jargon Buster
Search any AI term, explained in plain English.
Type a term below and search. You will be taken straight to the tool.
Related terms
See how your CV performs against the ATS algorithms that screen candidates before a human ever reads your application.
Try the CV Optimiser →How AI job displacement actually works, what it means for your career, and what to do about it. Written by someone who has been in recruitment for 25 years.
When the Ground Shifts →