VENDORiQ: OpenAI Soon to Launch Developer Platform for Larger Workloads

OpenAI's new developer platform, Foundry, is set to revolutionise the future of artificial intelligence (AI) for enterprise users by enabling them to run OpenAI's model inference on dedicated capacity.

The Latest

14 March 2023: OpenAI announced that it will soon release Foundry, its developer platform designed for running larger workloads and allows inference at scale. Based on its product brief, Foundry is capable of static allocation, specific instances monitoring, workload optimisation, and complete control over the model snapshot. The company added that the tool will serve its future models.

Why It’s Important

One of Foundry’s features that will create a huge impact in the AI initiatives of large enterprises is its static allocation, so clients can control their dedicated compute units when developing applications on top of foundational models. This is a cost-effective solution given the huge improvement in the context length for more memory and recall since it will now support 32,000 tokens, or eight times larger than the current Text-Davinci-003 model at 4,096.

In addition, Foundry’s total three-month commitment runs at USD468,000 for 600 units or instance, to more than USD1.5 million for a 1-year commitment – a pricing structure that caters only to the AI development project budget of large organisations. It comes as no surprise then why OpenAI is currently in talks with Spotify, Bain and Coca-Cola.

Who’s impacted

  • CEO
  • AI developers
  • IT teams

What’s Next?

  • Determine your organisation’s AI maturity model by referring to the IBRS framework, and from there, take the necessary steps to raise awareness, educate executives, or predict ways to grow the enterprise. 
  • Weigh the benefits and disadvantages of hiring an in-house AI development team or external consultants.
  • Transactional volume should be carefully considered early in the planning stage to accrue the most value from the investments in research, design, development and, production in the long run.

Related IBRS Advisory

1. Five Things to Consider When Evaluating AI… and Five Dangerous AI Misconceptions

2. VENDORiQ: Microsoft Business Apps – The Inside Scoop on What’s Next

Trouble viewing this article?

Search