AI Jargon Buster
AI news and the language around it, simplified.
What is a Compute-to-Token Ratio?
This is a measurement of the relationship between the raw computing power used by a system and the amount of text or data it generates. In this context, a token is a small piece of text, such as a word or part of a word. The ratio tracks how much energy and hardware capacity is consumed to produce a specific volume of output. By monitoring this, organizations can determine if a model is operating efficiently or if it is wasting resources on simple tasks that should not require such heavy processing power.
Why this matters to you
Business leaders use this metric to manage budgets and ensure that AI tools remain profitable. If the ratio is too high, the cost of running the software may outweigh the value it provides to the company, making it necessary to switch to a more efficient model or simplify the task.
How you might hear this
We need to optimize our prompts because our current compute-to-token ratio is making the project too expensive to scale across the entire department.
AI Jargon Buster
Search any AI term, explained in plain English.
Type a term below and search. You will be taken straight to the tool.
Related terms
See how your CV performs against the ATS algorithms that screen candidates before a human ever reads your application.
Try the CV Optimiser →How AI job displacement actually works, what it means for your career, and what to do about it. Written by someone who has been in recruitment for 25 years.
When the Ground Shifts →