How much Generative AI can I use? How is it calculated?
Talkative uses AI Tokens to licence the consumption of AI that you use in the Talkative platform.
An AI Token is used each time that the system sends a "look up" to an AI model.
Each organisation has 50 tokens per month free of charge.
You are able to buy more tokens from Talkative in bundles, please contact us for pricing.
FAQs
Q: What is a token?
A: Tokens are required each time Talkative gets a response from the AI (a lookup). The number of tokens required depends on the LLM you use:
| AI Model | AI Tokens used per lookup/request |
GPT-4o mini | 1 |
| GPT-4o | 10 |
| Claude Sonnet | 20 |
| Claude Haiku | 1 |
| LLAMA 3 (70B) | 5 |
| LLAMA 3 (8B) | 1 |
| Gemini 1.5 Pro | 10 |
| Gemini 1.5 Flash | 1 |
For example, if you are using GPT4o and the customer asks a question of your Talkative chatbot where an AI lookup is required, this will use 10 tokens. Tokens are required both for chatbot interactions and agent assist interactions.
Q: Which features use tokens?
A: Tokens are required for the following features:
| GenAI Feature | Uses tokens? |
| GenAI chatbot | Yes |
| Copilot - Autocomplete | Yes |
| Copilot - Suggested Responses | Yes |
| Copilot - Navi | Yes |
| Agent message rephrase | No |
| AI insights reports | No |
| AI phrase matching | No |
| AI agent training | No |
Q: Why use tokens?
A: A token is used to give flexibility as new models are introduced over time, and is the closest way of passing the underlying cost over to you.
Q: What if I hit my token limit
A: Your system will still work. However, Agent Assist will no longer show suggestions. And any AI lookups in your chatbot will go down the "Data not found" path.
Q: I'm only a little bit over my limit
A: Please contact us if you require a small (<5%) overage for a particular month.
Q: Where can I see my token usage?
A: Go to Settings > Billing.
Q: Do tokens rollover each month?
A: No, a token limit is reset at the start of each calendar month.
Q: Can I buy more tokens each month?
A: Yes you can buy more token bundles at any point.
Q: What tier do I need to be on?
A: Any Talkative subscription tier lets you use AI tokens.
Was this article helpful?
That’s Great!
Thank you for your feedback
Sorry! We couldn't be helpful
Thank you for your feedback
Feedback sent
We appreciate your effort and will try to fix the article