New request

#691: Feature request: Model health comparison table with replacement guide

We'll provision a sandbox, run an agent against the issue, and open a draft PR. You can pull the branch and iterate from there.

opengithub.com/nesquena/hermes-webui/issues/691 →

Issue

enhancementmonitoring

This feature is needed by users running multi-agent Hermes swarms. A reference implementation exists in the Hermes Control Interface repo. Please add a table showing all models currently assigned to agents, with columns for quality score, hallucination rate, cost per 1M tokens, and a recommended cheaper/better replacement. This gives users running provider-agnostic multi-model swarms a single place to make informed model-swap decisions.

Assessmentadvisory

feature●● medium80% confidence

Requires new API endpoint to aggregate model metrics and a frontend comparison table with replacement recommendations.

Likely files

api/routes/models.py
static/js/model_comparison.js
api/services/model_registry.py
static/css/tables.css
static/index.html
api/models/model_health.py
tests/api/test_model_health.py

Create the request