Cognipeer Console

Open-source, self-hosted AI gateway for multi-tenant organizations — OpenAI-compatible LLM routing, RAG, agent orchestration, GPU fleet management, AI red-teaming, and cost optimization behind one production-ready console.

Community edition is available under AGPL-3.0. Commercial licensing, hosted deployments, and support agreements are available separately through Cognipeer.

Features

Gateway

• LLM Gateway — OpenAI-compatible chat completions, embeddings, batch, and moderations across OpenAI, Anthropic, AWS Bedrock, Google Vertex AI, vLLM, Ollama, and more
• Model Hub & Dynamic Routing — Fallback chains and per-model quota/rate limiting
• Realtime — WebSocket voice agents with barge-in and tool-call events

Agents & Automation

• MCP Hub — Curate, host, and discover Model Context Protocol servers (OpenAPI, remote, stdio) with per-tool controls
• Agent Sandboxes — Isolated coding-agent dev environments with snapshot/fork/resume and port-forwarded previews
• Browser Automation — Managed browser profiles, live sessions, and per-browser MCP endpoints
• A2A Protocol — Publish Console-managed agents as Agent-to-Agent servers with agent cards
• Prompt Management — Versioned templates with environment-based deployment (dev/staging/prod) and a built-in prompt optimizer

Knowledge & Retrieval

• RAG / Knowledge Engine — Document ingestion, chunking, embedding, and retrieval
• Web Crawler & Web Search — Scheduled or ad-hoc crawling plus a built-in search provider
• Vector Store Management — Multi-provider vector operations (Pinecone, Chroma, Qdrant, and more) with built-in SQLite vector support
• OCR & Rerankers — Layout/table-aware document extraction and Cohere-compatible reranking
• Semantic Memory — Scoped memory stores with vector-based recall

Observability & Evaluation

• Agent Tracing — Batch and streaming ingest, OTLP/HTTP JSON, and an OpenTelemetry exporter
• Evaluations — Datasets, AI-assisted labeling, and accuracy scoring
• Inference Monitoring & Alerts — Real-time monitoring for self-hosted inference servers with rule-based alerting

Safety & Compliance

• Guardrails — PII detection, content moderation, prompt shields, and custom LLM-based evaluators
• AI Red-Teaming — OWASP LLM Top 10 probes, campaigns, and attack runs
• Audit Logging — Tenant-scoped audit trails

Infrastructure & Cost

• GPU Fleet — Pooled GPU inference with MIG slicing, Hugging Face catalog deploys, and capacity planning
• Cost Intelligence — Spend tracking, budgets, and automated optimization prescriptions
• Multi-Tenant Architecture — Complete data isolation per tenant, projects, groups, and LDAP/SSO-ready auth
• File Management — Multi-provider file storage with automatic Markdown conversion
• Quota & Rate Limiting — Multi-dimensional quota enforcement with plan-level defaults

Quick Start

Prerequisites

• Node.js 20+
• npm

Installation

git clone https://github.com/Cognipeer/cognipeer-console.git
cd cognipeer-console
npm install
cp .env.example .env.local
npm run dev

The gateway starts with SQLite by default — no external database required.

Visit http://localhost:3000 to access the dashboard.

Docker

docker compose up -d

Or build and run manually:

docker build -t cognipeer-console .
docker run -p 3000:3000 -v ./data:/app/data -e JWT_SECRET=your-secret-here cognipeer-console

Architecture

┌────────────────────────────────────────────────────┐
│                    Next.js App                      │
├──────────────┬──────────────┬──────────────────────┤
│  Dashboard   │  Client API  │    Dashboard API     │
│   (UI)       │ /client/v1/* │    /api/*            │
├──────────────┴──────────────┴──────────────────────┤
│                  Middleware                         │
│         (JWT Auth + Feature Gates + CORS)           │
├────────────────────────────────────────────────────┤
│                 Service Layer                       │
│ Models │ Vector │ Knowledge Engine │ Memory │ Tracing │
├────────────────────────────────────────────────────┤
│              Provider Registry                      │
│  Contracts → Runtimes (LLM, Vector, File)          │
├────────────────────────────────────────────────────┤
│             Database Abstraction                    │
│           SQLite (default) │ MongoDB               │
├────────────────────────────────────────────────────┤
│               Core Infrastructure                   │
│  Config │ Logger │ Cache │ Resilience │ Health     │
└────────────────────────────────────────────────────┘

Technology Stack

• Framework: Next.js 15 (App Router) + TypeScript
• UI: Mantine v8 + Tailwind CSS
• Database: SQLite (default, zero-dependency) or MongoDB
• Auth: JWT (jose) + API tokens
• Cache: None / Memory / Redis
• Logging: Winston with structured context

Configuration

All configuration is managed through environment variables. See .env.example for the full list.

Key variables:

Variable	Default	Description
DB_PROVIDER	sqlite	Database backend (sqlite or mongodb)
JWT_SECRET	—	Required. Secret for JWT signing
MAIN_DB_NAME	cgate_main	Main database name
CACHE_PROVIDER	memory	Cache backend (none, memory, redis)
RATE_LIMIT_PROVIDER	mongodb	Rate limit backend (mongodb, memory, redis)
BROWSER_BLOCK_PRIVATE_NETWORK	true	Block private-network egress from managed browser sessions
CORS_ENABLED	false	Enable CORS for client APIs

For the full configuration reference, see the Configuration Guide.

Client API

The gateway exposes an OpenAI-compatible API at /api/client/v1/:

# Chat completion
curl -X POST http://localhost:3000/api/client/v1/chat/completions \
  -H "Authorization: Bearer <API_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{"model": "gpt-4", "messages": [{"role": "user", "content": "Hello"}]}'

# Embeddings
curl -X POST http://localhost:3000/api/client/v1/embeddings \
  -H "Authorization: Bearer <API_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{"model": "text-embedding-3-small", "input": "Hello world"}'

See openapi.yaml for the full API specification.

Official SDK

If you are building an application against Cognipeer Console, prefer the official TypeScript/JavaScript SDK:

• SDK repo: console-sdk
• SDK docs: cognipeer.github.io/console-sdk

Use this repository and its docs for platform setup, deployment, providers, tenancy, auth, and raw HTTP API semantics.

Documentation

Full documentation is available in the docs/ directory:

• Getting Started
• Architecture
• Configuration
• Deployment
• Multi-Tenancy
• API Reference
• Licensing
• Security

Build and preview the documentation site:

npm run docs:dev

Contributing

See CONTRIBUTING.md for development guidelines, code style, and PR checklist.

Security

Security reporting guidance is in SECURITY.md. Do not disclose vulnerabilities in public issues.

License

This repository is licensed under the GNU Affero General Public License v3.0. See LICENSE for the full text.

If you want to embed Cognipeer Console in a closed-source product, offer a proprietary hosted derivative without AGPL obligations, or purchase support/SLA coverage, see COMMERCIAL.md.