NVIDIA showcased innovative technologies during NVIDIA GTC 2024 in San Jose, California. And although they all have different purposes, these technologies are united by one common element – generative AI, which is the center of attention.

Below you’ll see some of the tech trends showcased during NVIDIA GTC that we hear about from TechRepublic.

Advanced generation with advanced search

A technology that aims to reduce AI “hallucinations” or inaccuracies, advanced search generation allows the generative AI model to check its work against external resources, such as scientific papers or documents. RAG appeals to enterprise customers because it increases the reliability of the generated content.

“AI factories” to increase storage and computing needs

Many NVIDIA GTC organizations have described themselves as “AI factories” that provide enterprises with access to the storage and computing power they need to create artificial intelligence.

NexGen Cloud, which calls this service “GPUaaS,” is among the companies that will provide access to NVIDIA’s 10 trillion-parameter Blackwell GPU (Figure A) later this year.

Ten trillion parameter jobs require a lot of compute, and organizations are betting they can create a business model by providing just the right amount of compute power to customers.

During a preview briefing on March 15, Greg Findlen, senior vice president of product management for data management at Dell, shared that data storage must support high-performance structured data as well as unstructured data, such as documents, images and video.

Edge AI

Organizations that focus on edge AI also took their place at NVIDIA GTC 2024, with a wide variety: robotics, automotive, industrial, healthcare, mission-critical systems, and retail.

Many of these were powered by NVIDIA’s Jetson robotics platform. Jetson Orin’s NVIDIA Metropolis microservices allow developers to use API calls to create generative AI capabilities, making robots more reactive and flexible to their environment.

Private AI for enterprises

Organizations are working on creating private generative AI that can securely access their own data while providing the flexibility of a publicly available AI like ChatGPT.

During the show, NVIDIA mentioned Mistral AI several times, which provides a large open source language model that customers can host on their own servers.

Copilots can draw on company-owned data

NVIDIA GTC features a wide range of AI Copilots that can draw answers from specific, company-owned structured and unstructured data.