AI Token Licensing

Created by Seb Coulthread, Modified on Fri, 21 Jun 2024 at 01:33 PM by Felix Winstone

How much Generative AI can I use? How is it calculated?

Talkative uses AI Tokens to licence the consumption of AI that you use in the Talkative platform.

An AI Token is used each time that the system sends a "look up" to open AI. This is used in:

• generative responses from Talkative Chatbot

• AI Agent Assist.

Each organisation has 50 tokens per month free of charge.

You are able to buy more tokens from Talkative in bundles, please contact us for pricing.


FAQs

Q: What is a token?

A: Tokens are required each time Talkative gets a response from the AI (a lookup). The number of tokens required depends on the GPT model you use:


AI ModelAI Tokens used per lookup/request

GPT-3.5

1

GPT-4

20
GPT-4o20
Claude Sonnet
20
Claude Haiku
1
LLAMA 3 (70B)5
LLAMA 3 (8B)
1

For example, if you are using GPT3.5 and the customer asks a question of your Talkative chatbot where an AI lookup is required, this will use 1 token. Tokens are required both for chatbot interactions and agent assist interactions.


Q: Which features use tokens?

A: Tokens are required for the following features:

GenAI FeatureUses tokens?
GenAI chatbotYes
Copilot - AutocompleteYes
Copilot - Suggested ResponsesYes
Copilot - NaviYes
Agent message rephraseNo
AI insights reportsNo
AI phrase matchingNo
AI agent training No



Q: Why use tokens?

A:  A token is used to give flexibility as new models are introduced over time, and is the closest way of passing the underlying cost over to you.

 

Q: What if I hit my token limit

A: Your system will still work. However, Agent Assist will no longer show suggestions. And any AI lookups in your chatbot will go down the "Data not found" path.

 

Q: I'm only a little bit over my limit

A: Please contact us if you require a small (<5%) overage for a particular month.

 

Q: Where can I see my token usage?

A: Go to Settings > Billing.

 

Q: Do tokens rollover each month?

A: No, a token limit is reset at the start of each calendar month.

 

Q: Can I buy more tokens each month?

A: Yes you can buy more token bundles at any point.

 

Q: What tier do I need to be on?

A: Any Talkative subscription tier lets you use AI tokens.




Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select atleast one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article