Back to work

AI/ML / 2024 / Maintained

Real-Time Vision Operations Platform

Browser-to-inference platform for streaming camera frames to a FastAPI detection service, visualising detections in the browser, and monitoring streaming behaviour in real time.

Role

Designer and engineer (solo)

Disciplines

Perception / AI Integration / Backend Systems / Full-Stack

Status

Maintained

Real-Time Vision Operations Platform preview

What this system solves

Computer vision portfolios usually live in notebooks — hard for hiring teams to actually run, and disconnected from real product surfaces. Streaming inference under backpressure is rarely shown end-to-end.

System overview

React/Vite client captures webcam or video frames, sends them through a WebSocket to a FastAPI frame processor, and renders bounding-box overlays plus throughput, latency, and confidence telemetry. A detector abstraction lets the system run with a deterministic mock detector by default and an optional YOLOv8 adapter when weights are supplied.

Engineering decisions

Stale frames are intentionally dropped, not queued

In real-time vision systems, processing a stale frame is often worse than skipping it — the world has already moved on. The pipeline acknowledges one frame at a time and drops anything that arrives during processing.

Mock detector by default

Reviewers can verify the streaming architecture, backpressure behaviour, and dashboard wiring without GPU drivers or model weights. The mock is honestly labelled and emits deterministic detections.

Connection and payload limits at the boundary

Maximum connection counts, target FPS limits, and maximum frame-pixel limits sit at the WebSocket boundary so a misbehaving client cannot saturate the worker pool.

Limitations

  • Mock detector is deterministic — it does not represent the quality of a real trained model.
  • Single-node deployment; no orchestrated worker pool or distributed inference.
  • No persistent metrics store — telemetry is in-memory for the current session.

What would come next

  • Optional persistence layer for session telemetry and incident replay.
  • Per-tenant API tokens and quota tracking.
  • Multi-camera orchestration with deterministic frame routing.

Validation and results

Self-contained demo that runs in mock mode with zero setup, then upgrades to real YOLOv8 when weights are dropped in.