NVIDIA Clara Integrations

NVIDIA TensorRT is an ecosystem of APIs for high-performance deep learning inference, encompassing an inference runtime and model optimizations that deliver low latency and high throughput for production applications. Built on the CUDA parallel programming model, TensorRT optimizes neural network models trained on all major frameworks, calibrating them for lower precision with high accuracy, and deploying them across hyperscale data centers, workstations, laptops, and edge devices. It employs techniques such as quantization, layer and tensor fusion, and kernel tuning on all types of NVIDIA GPUs, from edge devices to PCs to data centers. The ecosystem includes TensorRT-LLM, an open source library that accelerates and optimizes inference performance of recent large language models on the NVIDIA AI platform, enabling developers to experiment with new LLMs for high performance and quick customization through a simplified Python API.

AWS Marketplace is a curated digital catalog that enables customers to discover, purchase, deploy, and manage third-party software, data products, AI agents, and services directly within the AWS ecosystem. It provides access to thousands of listings across categories like security, machine learning, business applications, and DevOps tools. With flexible pricing models such as pay-as-you-go, annual subscriptions, and free trials, AWS Marketplace simplifies procurement and billing by integrating costs into a single AWS invoice. It also supports rapid deployment with pre-configured software that can be launched on AWS infrastructure. This streamlined approach allows businesses to accelerate innovation, reduce time-to-market, and maintain better control over software usage and costs.

BioNeMo is an AI-powered drug discovery cloud service and framework built on NVIDIA NeMo Megatron for training and deploying large biomolecular transformer AI models at a supercomputing scale. The service includes pre-trained large language models (LLMs) and native support for common file formats for proteins, DNA, RNA, and chemistry, providing data loaders for SMILES for molecular structures and FASTA for amino acid and nucleotide sequences. The BioNeMo framework will also be available for download for running on your own infrastructure. ESM-1, based on Meta AI’s state-of-the-art ESM-1b, and ProtT5 are transformer-based protein language models that can be used to generate learned embeddings for tasks like protein structure and property prediction. OpenFold, a deep learning model for 3D structure prediction of novel protein sequences, will be available in BioNeMo service.

NVIDIA® Holoscan is a domain-agnostic AI computing platform that delivers the accelerated, full-stack infrastructure required for scalable, software-defined, and real-time processing of streaming data running at the edge or in the cloud. Holoscan supports a camera serial interface and front-end sensors for video capture, ultrasound research, data acquisition, and connection to legacy medical devices. Use the NVIDIA Holoscan SDK’s data transfer latency tool to measure complete, end-to-end latency for video processing applications. Access AI reference pipelines for radar, high-energy light sources, endoscopy, ultrasound, and other streaming video applications. NVIDIA Holoscan includes optimized libraries for network connectivity, data processing, and AI, as well as examples to create and run low-latency data-streaming applications using either C++, Python, or Graph Composer.