QX Labs
All integrations
Honeyhive
QX Labs Icon
AI & ML

Let agents run your Honeyhive evaluations

QX kicks off evaluation runs, logs events, curates datasets and flags regressions—so your team ships reliable AI features instead of babysitting eval dashboards.

@QX Did anything regress in last night's eval run?
QX
Yes—your support-bot prompt dropped 12% on factuality versus Tuesday's baseline, mostly on refund questions. I pulled the 14 failing traces. Want me to file a Linear ticket for the team?
Honeyhive
Honeyhive
Linear
Linear

Stop hand-running evals, hunting bad traces, and rebuilding datasets every release. Let an agent do it.

Evaluations

Eval runs on autopilot

Every time your prompt, model or retriever changes, an agent fires off the right evaluation in Honeyhive, waits for results, and tells you exactly what got better or worse.

Datasets

Datasets that curate themselves

Real production traces get classified, deduped and added to the right dataset automatically—so your evals keep tracking what users actually do, not what you imagined six months ago.

Monitoring

Catch regressions before users do

An agent watches metrics and events, spots quality drops as they happen, and pings the right engineer with the failing traces already attached—no dashboard babysitting required.

Honeyhive

Real workflows, built for your team

Build complex workflows in minutes that chain Honeyhive together with the rest of your stack. Trigger them on specific events, on schedule, or on demand.

Engineering: Evaluate every prompt change before it ships

PR opened on prompt repo

PR opened on prompt repo

Triggered in GitHub

QX Labs Icon

Detect changed prompts & models

Agent step

Honeyhive

Start an evaluation run

in Honeyhive

Honeyhive

Pull experiment results

in Honeyhive

Quality score dropped
Block merge & comment results

Block merge & comment results

in GitHub

All metrics passed
Notify the AI team

Notify the AI team

Alert via Slack

QX agents can start evaluation runs, log events, curate datasets in Honeyhive—and a lot more

QUERYRetrieve events and traces
QUERYGet project metrics
QUERYGet experiment results
CREATEStart an evaluation run
CREATELog batch model events
CREATECreate a new dataset
UPDATEAdd datapoints to a dataset
UPDATEUpdate events with scores

+ 16 more actions

About Honeyhive

Honeyhive is an AI observability and evaluation platform built for teams shipping production LLM applications. It gives developers and domain experts a shared workspace to trace, evaluate and improve AI features—combining datasets, metrics, experiments and event-level traces under one roof, with a rich API that makes it a natural fit for automation.

About QX Labs

QX is an AI agent platform that helps you build, run and scale AI across your team in a few clicks. Create agents that connect to your data and 1,000+ apps, building institutional memory that gets sharper every run. Then delegate tasks to them from where you already work—Slack, Teams, WhatsApp or email.

See Honeyhive working inside your stack

Want an AI co-worker that runs your evals and watches your AI features for regressions? Book a demo call to discuss your use cases, or get started for free.

Book a demo