infrence

A pure Elixir Datalog engine with semi-naive fixpoint evaluation, stratified negation, provenance tracking, and telemetry.

Fast, dependency-free LLM engine in Rust with custom SIMD kernels

Совместный проект курса в МФТИ по методам эффективной реализации моделей искусственного интеллекта

Rust SDK for writing custom backends for NVIDIA Triton Inference Server

Nectar-X-Studio is a powerful, Local AI-Inferencing application that allows the user download, create, run agents and run large language models on their own machine. With no internet connection required, Nectar ensures privacy-first, high-performance inference using cutting-edge open-source models from Hugging Face, Ollama, and beyond.

A Convolutional LSTM temperature prediction machine learning model with a interactive frontend to explore model inference.

Self-hosted AI Platform powered by vLLM, LiteLLM and Open WebUI

Local-first LLM toolkit: token/KV-cache/VRAM analyzer, Ollama paraphrase pipeline, and a weighted load-balancer with health checks. 100% local — no API keys, no data leaves your machine. 51 passing tests.

A benchmarking suite comparing vLLM and Ollama inference performance at scale using Ultrachat500k workloads, measuring latency, throughput, and concurrency scaling.