On Thursday, OpenAI introduced updates to the AI fashions that energy its ChatGPT assistant. Amid much less noteworthy updates, OpenAI tucked in a point out of a potential fix to a extensively reported “laziness” problem seen in GPT-Four Turbo since its launch in November. The corporate additionally introduced a brand new GPT-3.5 Turbo model (with decrease pricing), a brand new embedding model, an up to date moderation model, and a brand new technique to handle API utilization.

“As we speak, we’re releasing an up to date GPT-Four Turbo preview model, gpt-4-0125-preview. This model completes duties like code era extra totally than the earlier preview model and is meant to scale back instances of ‘laziness’ the place the model doesn’t full a activity,” writes OpenAI in its weblog submit.

Because the launch of GPT-Four Turbo, a lot of ChatGPT customers have reported that the ChatGPT-4 model of its AI assistant has been declining to do duties (particularly coding duties) with the identical exhaustive depth because it did in earlier variations of GPT-4. We have seen this habits ourselves whereas experimenting with ChatGPT over time.

OpenAI has by no means provided an official clarification for this modification in habits, however OpenAI workers have beforehand acknowledged on social media that the problem is actual, and the ChatGPT X account wrote in December, “We have heard all of your suggestions about GPT4 getting lazier! we’ve not up to date the model since Nov 11th, and this actually is not intentional. model habits may be unpredictable, and we’re wanting into fixing it.”

We reached out to OpenAI asking if it might present an official clarification for the laziness concern however didn’t obtain a response by press time.

New GPT-3.5 Turbo, different updates

Elsewhere in OpenAI’s weblog replace, the corporate introduced a brand new model of GPT-3.5 Turbo (gpt-3.5-turbo-0125), which it says will supply “varied enhancements together with increased accuracy at responding in requested codecs and a fix for a bug which brought on a textual content encoding concern for non-English language perform calls.”

And the price of GPT-3.5 Turbo by OpenAI’s API will lower for the third time this 12 months “to assist our clients scale.” New enter token costs are 50 % much less, at $0.0005 per 1,000 enter tokens, and output costs are 25 % much less, at $0.0015 per 1,000 output tokens.

Decrease token costs for GPT-3.5 Turbo will make working third-party bots considerably inexpensive, however the GPT-3.5 model is usually extra prone to confabulate than GPT-Four Turbo. So we would see extra situations like Quora’s bot telling those who eggs can soften (though the occasion used a now-deprecated GPT-3 model referred to as text-davinci-003). If GPT-Four Turbo API costs drop over time, a few of these hallucination points with third events would possibly ultimately go away.

OpenAI additionally introduced new embedding fashions, text-embedding-3-small and text-embedding-3-large, which convert content material into numerical sequences, aiding in machine studying duties like clustering and retrieval. And an up to date moderation model, text-moderation-007, is a part of the corporate’s API that “permits builders to establish probably dangerous textual content,” in accordance with OpenAI.

Lastly, OpenAI is rolling out enhancements to its developer platform, introducing new instruments for managing API keys and a brand new dashboard for monitoring API utilization. Builders can now assign permissions to API keys from the API keys web page, serving to to clamp down on misuse of API keys (in the event that they get into the flawed fingers) that may probably price builders plenty of cash. The API dashboard permits devs to “view utilization on a per function, staff, product, or challenge stage, just by having separate API keys for every.”

Because the media world seemingly swirls across the firm with controversies and assume items concerning the implications of its tech, releases like these present that the dev groups at OpenAI are nonetheless rolling alongside as traditional with updates at a reasonably common tempo. Regardless of the corporate virtually fully falling aside late final 12 months, it appears that evidently, below the hood, it is enterprise as traditional for OpenAI.