Website: projectdmx.github.io
- DMI — A decoupled, asynchronous observation substrate for high-speed LLM inference.
ProjectDMX
Pinned Loading
Repositories
Showing 9 of 9 repositories
- DMI-vLLM-Integration Public
- transformers-DMI Public Forked from huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- ProjectDMX.github.io Public
- vllm-DMI Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
- Megatron-LM-DMI Public Forked from NVIDIA/Megatron-LM
Ongoing research training transformer models at scale
- .github Public
- TensorRT-LLM-baseline Public Forked from NVIDIA/TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
- vLLM-Hook-baseline Public Forked from IBM/vLLM-Hook
Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…