Nutanix (NASDAQ: NTNX), a leader in hybrid multi-cloud computing, announced up-to-date Nutanix GPT-in-a-Box functionality, including integration with NVIDIANIM inference microservices i Face Hugging Library of Gigantic Language Models (LLM). Additionally, the company announced the Nutanix AI Partner Program, which aims to bring together leading AI solutions and services partners to support customers looking to run, manage and secure generative artificial intelligence (GenAI) applications on the Nutanix Cloud Platform and GPT-in-a-Box . Nutanix GPT-in-a-Box is an end-to-end solution designed specifically to simplify enterprise AI deployment through tight integration with Nutanix objects and Nutanix files for storing models and data.
Nutanix GPT-in-a-Box 2.0
The company announced GPT-in-a-Box 2.0, which will provide enhanced NVIDIA compute acceleration and LLM support, as well as simplified core model management and integration with NVIDIA NIM microservices and the Hugging Face LLM library. GPT-in-a-Box 2.0 will include a unified user interface for managing base models, creating API endpoints, managing end-user access keys, and will integrate Nutanix files and objects and NVIDIA Tensor Core GPUs.
GPT-in-a-Box 2.0 will bring the ease of operate of Nutanix with a built-in graphical user interface, role-based access control, auditing capabilities, and shadowy site support, among other benefits. It will also provide a point-and-click user interface. deploy and configure NVIDIA NIMpart of the NVIDIA AI Enterprise software platform for developing and deploying production-grade AI to easily deploy and run GenAI workloads across enterprises and edge devices.
Partnering with Hugging Face to provide integrated access to the LLM library
Nutanix also announced a partnership with Hugging Face to support customers accelerate their AI journey by providing integrated access to the Hugging Face library and LLM fulfillment for Nutanix customers. Joint customers will be able to leverage Nutanix GPT-in-a-Box 2.0 to easily utilize approved LLMs with Hugging Face and complete them efficiently.
Through this partnership, Nutanix and Hugging Face will develop custom integration with Text Generation Inference, Hugging Face’s popular open-source library for production deployment of gigantic language models, and enable text generation models available in the Hugging Face Hub in Nutanix GPT-in-the-Box 2.0. It will provide a seamless workflow for implementing approved AI LLMs from Hugging Face with full support from Nutanix, significantly increasing the number of LLMs supported. This will create a jointly validated and maintained workflow for the Hugging Face and LLM libraries, providing customers with a single point of management for consistent model inference.
A strengthened unstructured data platform for AI/ML
Nutanix has also improved its unstructured data platform for AI/ML and other applications, increasing performance, density and total cost of ownership. Nutanix Unified Storage (NUS) now supports a up-to-date low-cost all-NVMe platform with a density of over 550 terabytes and sequential read throughput of up to 10 Gigabytes/second from a single node (close to line speed for a 100 Gigabit Ethernet port), enabling faster data reads and more effective utilization GPU resources. Nutanix will also add support NVIDIA GPUDirect storage to further accelerate AI/ML applications. Additionally, to protect extremely valuable and often confidential data, such as datasets used to train and process AI/ML workloads, Nutanix Data Lens extends the value of cyber resilience to objects in addition to file data. The up-to-date Data Lens presence in Frankfurt enables wider adoption among customers in the EU, meeting their own compliance needs.
Nutanix has worked with major server OEMs to provide customers with a broad selection and broad selection of AI-optimized GPUs and density-optimized GPU systems. These AI-optimized GPUs, including NVIDIA L40S, H100, L40AND L4 GPUs are now supported in Nutanix GPT-in-a-Box. Nutanix now also supports density-optimized GPU systems from Dell, HPE and Lenovo to support lower total cost of ownership by enabling customers to deploy fewer systems to meet workload requirements. The company also announced planned support for the NX-9151-based NVIDIA MGX reference architecture.
Nutanix AI Affiliate Program
To further support customers’ AI strategies, Nutanix announced a up-to-date AI Partner Program, providing customers with simplified access to an expanded ecosystem of AI partners to deliver GenAI solutions in the real world. Partners will support organizations build, run, manage and secure third-party and first-party GenAI applications powered by the Nutanix Cloud Platform and Nutanix GPT-in-a-Box for their most critical AI operate cases.
This broad ecosystem of partners will support address a variety of operate cases, including operations, cybersecurity, fraud detection and customer service, across industries such as healthcare, financial services, and legal and professional services. Initial partners include: Codeium, DataRobot, DKube, Instabase, Lamini, Neural Magic, Stalwart Intelligence, RunAI and UbiOps.
Partner program benefits include:
- Nutanix AI Ready Validation: All partners will receive Nutanix AI Ready verification to demonstrate interoperability with Nutanix cloud infrastructure, the Nutanix AHV hypervisor, and the Nutanix Kubernetes platform.
- Full-stack solutions: Program partners will benefit from individual solution descriptions highlighting the benefits of Nutanix and partners. Additionally, selected partners will receive a technical note, best practice guide or reference architecture to simplify implementation across mutual customers.
- Alignment of promotions and market entry: Partners will benefit from go-to-market and demand generation activities focused on enterprise AI applications. They will have access to promotional and go-to-market opportunities including content creation, blog posts, webinars, podcasts and other events to support drive awareness and demand for key operate cases.
Nutanix GPT-in-a-Box 2.0 is expected to be available in the second half of 2024. Support for NVIDIA GPU Direct and NX-9151 is currently in progress. Additional features announced in NUS, as well as Data Lens, are now available to customers. More information can be found Here.