Oracle Cloud Infrastructure First to Run NVIDIA AI Supercomputing Cases; Microsoft Azure, Google Cloud and Others to Host DGX Cloud Quickly
GTC—NVIDIA at present introduced NVIDIA DGX™ Cloud , an AI supercomputing service that provides enterprises rapid entry to the infrastructure and software program wanted to coach superior fashions for generative AI and different groundbreaking functions.
DGX Cloud supplies devoted clusters of NVIDIA DGX AI supercomputing, paired with NVIDIA AI software program. The service makes it doable for each enterprise to entry its personal AI supercomputer utilizing a easy internet browser, eradicating the complexity of buying, deploying and managing on-premises infrastructure.
Enterprises hire DGX Cloud clusters on a month-to-month foundation, which ensures they will shortly and simply scale the event of enormous, multi-node coaching workloads with out having to attend for accelerated computing sources which are typically in excessive demand.
“We’re on the iPhone second of AI. Startups are racing to construct disruptive merchandise and enterprise fashions, and incumbents want to reply,” stated Jensen Huang, founder and CEO of NVIDIA. “DGX Cloud offers prospects on the spot entry to NVIDIA AI supercomputing in global-scale clouds.”
NVIDIA is partnering with main cloud service suppliers to host DGX Cloud infrastructure, beginning with Oracle Cloud Infrastructure (OCI). Its OCI Supercluster supplies a purpose-built RDMA community, bare-metal compute and high-performance native and block storage that may scale to superclusters of over 32,000 GPUs.
Microsoft Azure is anticipated to start internet hosting DGX Cloud subsequent quarter, and the service will quickly increase to Google Cloud and extra.
Business Titans Undertake NVIDIA DGX Cloud to Velocity Success
Amgen, one of many world’s main biotechnology corporations, insurance coverage expertise chief CCC Clever Options (CCC), and digital-business-platform supplier ServiceNow are among the many first AI pioneers utilizing DGX Cloud.
Amgen is utilizing DGX Cloud with NVIDIA BioNeMo ™ massive language mannequin software program to speed up drug discovery, together with NVIDIA AI Enterprise software program, which incorporates NVIDIA RAPIDS ™ knowledge science acceleration libraries.
“With NVIDIA DGX Cloud and NVIDIA BioNeMo, our researchers are in a position to give attention to deeper biology as a substitute of getting to cope with AI infrastructure and arrange ML engineering,” stated Peter Grandsard, government director of Analysis, Biologics Therapeutic Discovery, Heart for Analysis Acceleration by Digital Innovation at Amgen. “The highly effective computing and multi-node capabilities of DGX Cloud have enabled us to attain 3x sooner coaching of protein LLMs with BioNeMo and as much as 100x sooner post-training evaluation with NVIDIA RAPIDS relative to various platforms.”
CCC , a number one cloud platform for the property and casualty insurance coverage financial system, is utilizing DGX Cloud to hurry and scale the event and coaching of its AI fashions. These fashions energy the corporate’s revolutionary auto claims decision options, serving to to speed up the clever automation of the business and enhance the claims expertise for thousands and thousands of enterprise customers and their customers day-after-day.
ServiceNow is utilizing DGX Cloud with on-premises NVIDIA DGX supercomputers for versatile, scalable hybrid-cloud AI supercomputing that helps energy its AI analysis on massive language fashions, code technology, and causal evaluation. ServiceNow additionally co-stewards the BigCode challenge, a accountable open-science generative AI initiative, which is skilled on the Megatron-LM framework from NVIDIA.
Open a Browser to NVIDIA AI Supercomputing and Software program
Enterprises handle and monitor DGX Cloud coaching workloads utilizing NVIDIA Base Command™ Platform software program, which supplies a seamless person expertise throughout DGX Cloud, in addition to on-premises NVIDIA DGX supercomputers. Utilizing Base Command Platform, prospects can match their workloads to the correct quantity and kind of DGX infrastructure wanted for every job.
DGX Cloud contains NVIDIA AI Enterprise, the software program layer of the NVIDIA AI platform, which supplies end-to-end AI frameworks and pretrained fashions to speed up knowledge science pipelines and streamline the event and deployment of manufacturing AI. New pretrained fashions, optimized frameworks and accelerated knowledge science software program libraries, out there in NVIDIA AI Enterprise 3.1 launched at present , give builders a further jump-start to their AI initiatives.
Every occasion of DGX Cloud options eight NVIDIA H100 or A100 80GB Tensor Core GPUs for a complete of 640GB of GPU reminiscence per node. A high-performance, low-latency cloth constructed with NVIDIA Networking ensures workloads can scale throughout clusters of interconnected methods, permitting a number of situations to behave as one huge GPU to fulfill the efficiency necessities of superior AI coaching. Excessive-performance storage is built-in into DGX Cloud to supply an entire resolution for AI supercomputing.
DGX Cloud options help from NVIDIA specialists all through the AI improvement pipeline. Prospects can workdirectly with NVIDIA engineers to optimize their fashions and shortly resolve improvement challenges throughout a broad vary of business use instances.
Availability
DGX Cloud situations begin at $36,999 per occasion per thirty days. Organizations can contact their NVIDIA Associate Community consultant for extra particulars.