In a move to solidify its position in the large language model (LLM) market, OpenAI has introduced a slew of new enterprise-grade features for its API customers. This expansion comes despite the rapid rise of Meta’s Llama 3, which has quickly become a popular choice among developers and businesses. OpenAI’s Head of Product, API, Olivier Godement, welcomes the competition, stating that it drives innovation and improvement in the industry.
The new features include:
- Private Link: A secure method for direct communication between Microsoft’s Azure cloud service and OpenAI, minimizing exposure to the open internet.
- Enhanced security stack: Adding native Multi-Factor Authentication (MFA) and bolstering access control to meet growing compliance demands.
- Upgraded Assistants API: Handling 500 times more files, with improved file retrieval capabilities, streaming for real-time conversational responses, and better file management.
- Projects: A feature allowing enterprises to control and partition access to specific tasks and assignments, simplifying project management.
- Cost management features: Discounted rates for consistent token usage and a 50% reduction in costs for asynchronous workloads through the new Batch API.
These updates demonstrate OpenAI’s focus on providing a more “plug and play” experience for enterprises, countering the ascent of Llama 3 and open models from other companies. With its emphasis on enterprise-grade security, administrative control, and cost management, OpenAI aims to maintain its lead in the LLM market.
