NVIDIA Corporation
- 28.6k followers
- 2788 San Tomas Expressway, Santa Clara, CA, 95051
- https://nvidia.com
Pinned Loading
Repositories
- nvcf Public
Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.
- TensorRT-LLM Public
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
- infra-controller Public
NVIDIA Infra Controller - Hardware Lifecycle Management and multitenant networking
- nvrc Public
The NVRC project provides a Rust binary that implements a simple init system for microVMs.
- nvidia-resiliency-ext Public
NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the effective training time by minimizing the downtime due to failures and interruptions.
- NeMo-Retriever Public
NeMo Retriever Library is a scalable, performance-oriented document content and metadata extraction microservice. NeMo Retriever Library uses specialized NVIDIA NIM microservices to find, contextualize, and extract text, tables, charts and images that you can use in downstream generative applications.
Top languages
Loading…
Most used topics
Loading…