Skip to content

[Story 3/3] Tutorial: High-Throughput IoT Telemetry Pipeline with AMQP Workers & AI Diagnostics #41

Description

@crapougnax

🎯 Story Overview

As a Distributed Systems & IoT/AI Architect,
I want to build an industrial telemetry acquisition pipeline that decouples sensor frame ingestion via RabbitMQ workers, manages physical device capabilities via MDM ontology, routes data across polyglot backends (PostgreSQL, AMQP, S3), and triggers structured Gemini AI incident diagnoses on threshold breaches,
So that high-frequency edge IoT workloads run asynchronously, resiliently, and sovereignly on on-premise or cloud infrastructure.


📦 Ecosystem Packages

  • @quatrain/mdm (Device Ontology, Hardware Capabilities Matrix)
  • @quatrain/queue & @quatrain/queue-amqp (RabbitMQ Broker, Worker Concurrency)
  • @quatrain/backend & @quatrain/backend-postgres (Device Registry & Telemetry Relational Store)
  • @quatrain/storage & @quatrain/storage-s3 (Cold Storage Telemetry Archiving)
  • @quatrain/ai & @quatrain/ai-gemini (Google Gemini, Schema-Guaranteed Diagnostic JSON)
  • @quatrain/auth-rbac (TarpitManager Anti-Abuse Rate Limiting)

📋 Child Tasks & Implementation Plan


✅ Acceptance Criteria

  1. MDM model supports multi-axis hardware capabilities (radio, power, sensor bus).
  2. RabbitMQ workers ingest sensor frames asynchronously with configurable concurrency (concurrency: 10).
  3. Endpoint protected against sensor flooding via TarpitManager.
  4. Anomaly detection invokes Gemini AI via generateStructured to output guaranteed diagnostic JSON schemas.
  5. Multi-arch Containerfile and docker-compose.yml for local stack (PostgreSQL + RabbitMQ + MinIO).
  6. Full runnable reference application under examples/iot-telemetry-engine.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationenhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions