Purpose-built inference engine for Mistral Shieldstral 1.0 3B safety classifier. Optimized for RTX 3050 4GB VRAM. Custom CUDA kernel, INT4 quantization, multimodal vision pipeline, FastAPI moderation API.
moderation cuda pytorch quantization mistral inference-engine int4 llm safetensors rtx3050 safety-classifier shieldstral
-
Updated
Aug 13, 2026 - Python