Oracle Offers AI-Driven Tools to Manage Data
OCI Generative AI service is a fully managed service that integrates large language models (LLMs) from Cohere and Meta Llama 2 to address business use cases.
January 24, 2024
Oracle announces general availability of its Oracle Cloud Infrastructure (OCI) Generative AI service, along with innovations to enable enterprises to use latest advancements in generative AI. OCI Generative AI service is a fully managed service that integrates large language models (LLMs) from Cohere and Meta Llama 2 to address business use cases. OCI Generative AI service now includes multilingual capabilities that support over 100 languages, an improved GPU cluster management experience, and flexible fine-tuning options.
Customers can use OCI Generative AI service in the Oracle Cloud and on-premises via OCI Dedicated Region.
OCI Generative AI Service
The OCI Generative AI service is a managed platform designed to incorporate large language models into various enterprise use cases. The new service supports models like Meta’s Llama 2 and Cohere’s Command 52/6B models, offering a multilingual embedding capability for more than 100 languages.
Enhancements such as LangChain integration, endpoint management and content moderation make it easier to work with LLMs. The service also includes improved GPU cluster management with multi-endpoint support and endpoint analytics features.
“Oracle’s AI focus is on solving real-world business use cases to enable widespread adoption in the enterprise. To do this, we are embedding AI across all layers of the technology stack by integrating generative AI into our applications and converged database, and offering new LLMs and managed services—all supported by a fast and cost-effective AI infrastructure,” says Greg Pavlik, senior vice president, AI and Data Management, Oracle Cloud Infrastructure. “Instead of providing a tool kit that requires assembling, we are offering a powerful suite of pre-built generative AI services and features that work together to help customers solve business problems smarter and faster.”
Simplifying Customization
To help customers address business issues focused on text generation, summarization and semantic similarity tasks, the latest models from Cohere and Meta Llama 2 will be available in a managed service that can be consumed via application programming interface calls. In addition, customers will be able to embed generative AI easily and securely into their technology stack, with data security and governance.
Customers may refine these models using their own data with retrieval augmented generation (RAG) techniques, so the models will understand internal operations. Now in beta, OCI Generative AI Agents service with a RAG agent combines the power of LLMs and enterprise search built on OCI OpenSearch to provide contextualized results that are enhanced with enterprise data. This agent enables users to converse with diverse enterprise data sources through natural language without the need for specialist skills. The information retrieved is current—even with dynamic data stores—and the results are provided with references to the original source data.
The initial beta release supports OCI OpenSearch. Upcoming releases will support a wider range of data search and aggregation tools and provide access to Oracle Database 23c with AI Vector Search and MySQL HeatWave with Vector Store. Oracle will deliver prebuilt agent-actions across its suite of software-as-a-service applications, including Oracle Fusion Cloud Applications Suite, Oracle NetSuite and industry applications such as Oracle Health.
Embedding Generative AI Across Layers
Oracle’s AI infrastructure and portfolio of cloud applications creates a powerful combination for customer trust. By integrating generative AI across its portfolio of cloud applications—including ERP, HCM, SCM, and CX—Oracle enables customers to use the latest innovations within their existing business processes.
In addition, Oracle is embedding generative AI capabilities into its database portfolio to enable customers to build their own AI-powered applications. With Autonomous Database Select AI, customers can accelerate application development or create new business solutions by combining their private enterprise data with the productivity and creativity of generative AI.
To help customers build, train, deploy, and manage LLMs with open source libraries such as Hugging Face’s Transformers or PyTorch, Oracle is also expanding the capabilities of OCI Data Science. The new OCI Data Science AI Quick Actions feature, which will be in beta next month, enables no-code access to a variety of open-source LLMs, including leading providers such as Meta or Mistral AI.
Sources: Press materials received from the company and additional information gleaned from the company’s website.
More Oracle Coverage
Subscribe to our FREE magazine,
FREE email newsletters or both!About the Author
DE EditorsDE’s editors contribute news and new product announcements to Digital Engineering.
Press releases may be sent to them via [email protected].