- Token
- A small piece of text used by an AI model. Tokens are not exactly the same as words; 100 English words may be roughly 130–150 tokens.
- Prompt
- Everything sent to the model: instructions, the user's question, prior chat messages and any included document content.
- Input tokens
- Tokens sent to the model. Providers normally charge separately for input and output.
- Output tokens
- Tokens generated by the model in its answer. Longer answers usually cost more.
- API request
- One call from an application to an AI provider, such as one chat message or one document summary.
- Context window
- The maximum combined amount of text a model can process in one request, including input and generated output.
- Prompt caching
- A lower price for eligible text that is repeated across requests and successfully reused by the provider.
- Cache hit
- A request where previously cached text is found and reused. Cache misses are charged at the normal input rate.
- Batch processing
- Submitting non-urgent requests for later completion, often at a discount. It is unsuitable for immediate conversations.
- Rate limit
- A provider cap on requests or tokens over a period. RPM means requests per minute, RPD means requests per day and TPM means tokens per minute.
- Base rate
- The provider's standard price before any eligible caching or batch discount.
- Effective rate
- The estimated rate used by this calculator after applying the selected, supported optimisation assumptions.
- Free-tier feasibility
- Whether your projected workload appears to fit the provider's stated free request and token limits.
- Monthly estimate
- An approximation based on your assumptions. It may exclude taxes, retries, images, audio, tools and other charges.