halofpx

Here is 1 public repository matching this topic...

julianmb / halofpx

Run Ornith, Qwen, Nemotron & DeepSeek optimized on AMD Strix Halo — unified OpenAI-compatible server with tuned ROCmFP4 quants, validated 262K context, vision support & hot-swap model zoo (iGPU + NPU)

vulkan moe quantization lemonade rocm multimodal model-server fastapi openai-api llama-cpp local-llm llm-inference gguf speculative-decoding fp4 strix-halo amd-ryzen-ai ornith halofpx

Updated Aug 21, 2026
Python

Improve this page

Add a description, image, and links to the halofpx topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the halofpx topic, visit your repo's landing page and select "manage topics."

Learn more