Skip to content
@hud-evals

hud

HUD

The platform for evaluations and RL environments for agents.
Wrap real software as environments, run benchmarks, and train with RL – locally or at scale.

PyPI version License Docs Discord X Follow Shop

Are you an enterprise building agents?

📅 Hop on a call or email us at 📧 founders@hud.ai


⚡️ Hello there, we are HUD!

HUD is an open-source platform for evaluating and training agents:

  • Turn any piece of software into an RL environment.
  • Run reproducible benchmarks and submit to public leaderboards.
  • Train agents with RL (GRPO) on top of those environments with any RL provider.
  • Inspect every tool call, observation, and reward in real time on hud.ai.

The core Python SDK lives in hud-evals/hud-python.

We love contributions!

Check our open hud-python issues and open pull requests for more information.


🧩 Highlights

  • 🧱 MCP environment skeleton – wrap any system as an MCP server so any agent can call it.
  • 📡 Live telemetry – traces for every trajectory and tool call, streamed to hud.ai.
  • 📊 Public benchmarks & leaderboards – OSWorld-Verified, SheetBench-50, and more at hud.ai/leaderboards.
  • 🌐 Cloud browsers – integrations for browser-based environments (AnchorBrowser, Steel, BrowserBase, etc.).
  • 🔁 Hot-reload dev loophud dev for iterating on environments without rebuilds.
  • 🧪 One-click RLhud rl to train GRPO policies on any HUD dataset.

Pinned Loading

  1. hud-python hud-python Public

    RL environments + evals for AI agents. Define once, train anything.

    Python 301 75

Repositories

Showing 10 of 60 repositories
  • hud-python Public

    RL environments + evals for AI agents. Define once, train anything.

    hud-evals/hud-python's past year of commit activity
    Python 301 MIT 75 2 9 Updated Sep 14, 2026
  • outline Public

    clone of outline

    hud-evals/outline's past year of commit activity
    TypeScript 0 0 0 21 Updated Sep 14, 2026
  • ml-template Public
    hud-evals/ml-template's past year of commit activity
    Python 0 BSD-3-Clause 2 0 21 Updated Sep 2, 2026
  • cybergym-opus5-handoff Public

    Reproducible CyberGym Claude Opus 5 Nix and Daytona evaluation handoff

    hud-evals/cybergym-opus5-handoff's past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Aug 27, 2026
  • hud-evals/hud-remote-browser's past year of commit activity
    Python 0 1 0 1 Updated Aug 24, 2026
  • hud-evals/coding-template's past year of commit activity
    Python 2 5 0 0 Updated Aug 19, 2026
  • hud-browser Public
    hud-evals/hud-browser's past year of commit activity
    Python 1 0 0 0 Updated Aug 19, 2026
  • hud-evals/zerodaybench-mlflow-example's past year of commit activity
    Python 0 0 1 11 Updated Aug 5, 2026
  • hud-evals/data-science-template's past year of commit activity
    Python 0 0 0 17 Updated Aug 4, 2026
  • hud-evals/assemble-bench's past year of commit activity
    Python 5 MIT 0 0 1 Updated Jul 29, 2026

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…