![]() ![]() Pricing is also being reduced for text-embedding-ada-002, one of OpenAI’s more popular text embedding models. Developers can now use the model for $0.0015 per 1,000 input tokens and $0.002 per 1,000 output tokens, which equates to roughly 700 pages per dollar. ![]() On the plus side, OpenAI says that it’s reducing pricing for GPT-3.5-turbo - the original, not the version with the expanded context window - by 25%. (OpenAI is testing a version of GPT-4 with a 32,000-token context window, but only in limited release.) OpenAI says that it can ingest around 20 pages of text in a single go - short of the hundreds of pages that AI startup Anthropic’s flagship model can process, notably. tokens fed into the model) and $0.004 per 1,000 output tokens (tokens the model generates). The new GPT-3.5-turbo offers four times the context length (16,000 tokens) of the vanilla GPT-3.5-turbo at twice the price - $0.003 per 1,000 input tokens (i.e. Models with small context windows tend to “forget” the content of even very recent conversations, leading them to veer off topic - often in problematic ways. Context window, measured in tokens, or raw bits of text, refers to the text the model considers before generating any additional text. “Function calling allows developers to more reliably get structured data back from the model.”īeyond function calling, OpenAI is introducing a flavor of GPT-3.5-turbo with a greatly expanded context window. “These models have been fine-tuned to both detect when a function needs to be called … and to respond with JSON that adheres to the function signature,” OpenAI writes. ![]() As OpenAI explains in a blog post, function calling allows developers to describe programming functions to GPT-3.5-turbo and GPT-4 and have the models create code to execute those functions.įor example, function calling can help to create chatbots that answer questions by calling external tools, convert natural language into database queries and extract structured data from text. Today, OpenAI announced the release of new versions of GPT-3.5-turbo and GPT-4, the latter being its latest text-generating AI, with a capability called function calling. As the competition in the generative AI space grows fiercer, OpenAI is upgrading its text-generating models while reducing pricing. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |