Back to Projects

AEVO — Agentic Edge-Vision Optimizer

An autonomous MLOps pipeline that trains a YOLOv8 defect-detection model, uses the Claude API to analyse its own training metrics and self-tune hyperparameters in real time, then compresses the result for edge deployment — with no human in the loop.

AEVO YOLOv8n detecting PCB defects in real time
Live inference — YOLOv8n detecting 7 PCB defect classes in real time

The Challenge

Bringing a computer-vision model from a dataset to a deployable edge artifact is slow, manual, and expensive. An engineer trains a model, reads the curves, guesses a learning-rate change, retrains, and repeats — then separately wrestles with quantisation and export to hit a device's compute and memory budget. We wanted to prove that this entire loop could be automated end to end, with a reasoning agent making the optimisation decisions a human normally would.

AEVO is ROVOQ's in-house demonstration of that idea, built on a real industrial problem: PCB defect detection across 7 defect classes, with a hard constraint that the final model must run fast on a CPU-class edge device.

What We Built

An Autonomous Training Loop

AEVO trains a YOLOv8n model on 22,476 real-world PCB images. Every 5 epochs, it serialises its recent training metrics and sends them to the Claude API, which returns a structured JSON decision — reduce_lr, adjust_momentum, or continue — together with a plain-language rationale. The pipeline applies the decision and keeps training. No human watches the dashboard.

Epoch  35 | reduce_lr x0.5  — "val mAP50 declined 0.7477->0.7224 over 5 epochs"
Epoch  45 | reduce_lr x0.6  — "mAP50 plateaued at 0.735-0.739 for 5 epochs"
Epoch  55 | reduce_lr x0.5  — "mAP50 steadily declined 0.7375->0.7333"

Edge Compression Pipeline

Once the agent locks in a best checkpoint, AEVO exports it through a compression chain — PyTorch FP32 → ONNX → OpenVINO FP16 → OpenVINO INT8 — and benchmarks every format on a 100-image set. The INT8 edge target lands at 3.6 MB and 122.9 FPS on CPU, with under 2% accuracy drop versus the full-precision model.

AEVO inference benchmark across PyTorch, ONNX and OpenVINO formats
Benchmark across export formats — INT8 delivers the best size/speed trade-off for edge
Model size comparison across export formats
Model compressed from 6.3 MB to 3.6 MB for edge deployment

The Pipeline End to End

[Dataset] -> Module 1: Data Hub (validate + augment)
          -> Module 2: YOLOv8 Training Loop
               | every 5 epochs
               +-- Module 3: Claude Agent
                     analyse metrics -> JSON action
                     -> reduce_lr / adjust_momentum / continue
          -> Module 4: ONNX + OpenVINO INT8 compression
          -> Module 5: Benchmark Reporter (100-image inference)

Results

The agent made 12 API calls across the run and applied 4 learning-rate adjustments autonomously, converging to a strong detector that compresses cleanly to the edge:

75.4% Best mAP@50
122.9 FPS on CPU (INT8)
3.6 MB Edge Model Size
0 Humans in the Loop
AEVO training and validation curves
Training & validation curves over 60 epochs (early-stopped at patience 30)
AEVO model predictions on unseen PCB test boards
Live predictions on unseen test boards — short circuits, damaged joints, and solder slugs detected with confidence scores
Normalized confusion matrix for the PCB defect model
Normalised confusion matrix — per-class detection performance

Watch the Demo

A 94-second walkthrough of the full autonomous pipeline — training, the Claude agent's decisions, compression, and edge benchmarking:

Watch the AEVO showcase

Technology Stack

YOLOv8n (Ultralytics) Claude Sonnet 4.6 (Anthropic) PyTorch CUDA / AMP ONNX OpenVINO INT8 onnxruntime OpenCV Python 3.10+

Why It Matters

AEVO shows how ROVOQ combines computer vision, agentic AI, and edge optimisation into a single automated workflow. The same pattern — autonomous training, LLM-driven decisioning, and aggressive compression for on-device inference — applies directly to industrial inspection, quality control, and any vision system that has to run cheaply at the edge rather than in the cloud.

Need a Vision or Edge-AI System?

From dataset to a quantised model running on-device — we build automated computer-vision pipelines and deploy them to the edge. Let's talk about your inspection or detection problem.

Start a Project