What are OpenAI Tokens?
Language models by OpenAI are natural language processing models, which are essentially mathematical models that take words, break them down into tokens, and then analyze those tokens in order to predict the next set of words, or in the case of ChatGPT, a response.
Tokens are common sequences of characters found in text. The GPT family of models by OpenAI are specifically trained and built to predict the next token in a sequence of tokens, which then formulate to create words.