At the re:Invent 2023 conference, AWS announced an expanded collaboration with NVIDIA to drive innovative growth in generative artificial intelligence by introducing next-generation GPUs, CPUs, and artificial intelligence software.
AWS will be the first cloud service provider to offer the NVIDIA GH200 Grace Hopper Superchip with the new multi-node NVLink technology, enhancing the performance of individual Amazon EC2 instances and enabling customers to scale to thousands of GH200 Grace Hopper Superchips.
The NVIDIA DGX Cloud hosted on AWS will be able to drive generative AI applications and the training of large language models with over 200 trillion parameters through the GH1 Grace Hopper Superchip and the largest shared memory capacity of a single instance.
In addition, NVIDIA is collaborating with AWS on Project Ceiba, which aims to build the world's fastest artificial intelligence supercomputer. It will be equipped with 16384 NVIDIA GH200 Grace Hopper Superchips and can process up to 65 exaflops of artificial intelligence computing performance, thereby driving the next wave of self-generated artificial intelligence innovation.
AWS will launch three new Amazon EC2 instances: the P200e instance, powered by NVIDIA H5 Tensor Core GPUs, for large-scale and cutting-edge generative AI and HPC workloads; and the G4 and G40e instances, powered by NVIDIA L6 GPUs and NVIDIA L6S GPUs, respectively, for a wide range of applications including AI fine-tuning, inference, graphics, and video workloads. The latter is more suitable for developing 3D workflows, digital twins, and other applications using NVIDIA Omniverse.
Elsewhere, AWS is using the NVIDIA NeMo framework to train the next-generation Amazon Titan large-scale natural language model, while Amazon Robotics, Amazon's robotics subsidiary, is using NVIDIA Omniverse Isaac to build a digital twin environment. This allows for automation, optimization, and planning of autonomous operations in a virtual environment before actual real-world deployment to confirm overall operational issues.
