RME’s Agenthub
Submit listingSign in

Category

AI Testing & Monitoring

Tracing, evaluation, monitoring and quality tools for production AI systems.

Category results

Sponsored listings are shown first, followed by Premium listings and then Free listings. Sponsored placements may also repeat in long feeds and are always clearly labelled.

AI Testing & Monitoring

Confident AI

Confident AI is the evaluation platform behind the open-source DeepEval framework for testing LLM apps.

confident-ai.comVisit

AI Testing & Monitoring

Humanloop

Humanloop provides prompt management and evaluation tooling for teams building with LLMs.

humanloop.comVisit

AI Testing & Monitoring

Agenta

Agenta is an open-source LLMOps platform for prompt management, evaluation and observability.

agenta.aiVisit

AI Testing & Monitoring

Arthur

Arthur offers monitoring, evaluation and guardrails for ML models and AI agents.

arthur.aiVisit

AI Testing & Monitoring

Deepchecks

Deepchecks provides testing and evaluation for ML models and LLM applications.

deepchecks.comVisit

AI Testing & Monitoring

Evidently AI

Evidently AI offers open-source and cloud tools for evaluating and monitoring ML and LLM systems.

evidentlyai.comVisit

AI Testing & Monitoring

Future AGI

Future AGI provides evaluation and observability tooling for AI models and agents.

futureagi.comVisit

AI Testing & Monitoring

Giskard

Giskard provides testing and red-teaming tools for LLM agents and ML models.

giskard.aiVisit

AI Testing & Monitoring

Hamming AI

Hamming AI offers automated testing and monitoring for voice AI agents.

hamming.aiVisit

AI Testing & Monitoring

HoneyHive

HoneyHive is a platform for evaluating, tracing and monitoring AI agents and LLM apps.

honeyhive.aiVisit

AI Testing & Monitoring

Labelbox

Labelbox is a data labelling and evaluation platform for training AI models.

labelbox.comVisit

AI Testing & Monitoring

Lakera

Lakera provides security tooling that protects LLM applications against prompt injection and data leakage.

lakera.aiVisit

AI Testing & Monitoring

Lunary

Lunary is an open-source platform for LLM observability, prompt management and evaluations.

lunary.aiVisit

AI Testing & Monitoring

Maxim AI

Maxim AI is a platform for simulating, evaluating and observing AI agents.

getmaxim.aiVisit

AI Testing & Monitoring

Okareo

Okareo provides evaluation and error discovery tools for LLM applications and agents.

okareo.comVisit

AI Testing & Monitoring

Openlayer

Openlayer is a platform for testing, evaluating and monitoring AI systems.

openlayer.comVisit

AI Testing & Monitoring

Patronus AI

Patronus AI provides tools for evaluating and monitoring the reliability of LLM applications.

patronus.aiVisit

AI Testing & Monitoring

PromptLayer

PromptLayer is a platform for prompt management, versioning, evaluation and logging.

promptlayer.comVisit

AI Testing & Monitoring

Raindrop

Raindrop monitors AI products in production to surface user-facing issues.

raindrop.aiVisit

AI Testing & Monitoring

Scale AI

Scale AI provides training data, evaluation and data-labelling services for AI models.

scale.comVisit

AI Testing & Monitoring

Snorkel AI

Snorkel AI provides programmatic data development and evaluation for enterprise AI.

snorkel.aiVisit

AI Testing & Monitoring

Promptfoo

Open-source tool for testing and red-teaming LLM apps.

promptfoo.devVisit

AI Testing & Monitoring

MLflow

Open-source platform for AI development, tracking and evaluation.

open-sourceevaluationobservability
mlflow.orgVisit

AI Testing & Monitoring

Datadog Bits AI

AI assistance for observability and operational investigation.

observabilityoperationsmonitoring
datadoghq.comVisit

AI Testing & Monitoring

Grafana AI

AI-assisted observability across Grafana workflows.

observabilitymonitoringoperations
grafana.comVisit

AI Testing & Monitoring

Hotjar AI

AI-assisted behavior analytics and user feedback.

analyticsuser-feedbackheatmaps
hotjar.comVisit

AI Testing & Monitoring

New Relic AI

AI-assisted observability and incident investigation.

observabilitymonitoringoperations
newrelic.comVisit

AI Testing & Monitoring

Sentry Seer

AI-assisted debugging and issue analysis inside Sentry.

observabilitydebuggingdeveloper-tools
sentry.ioVisit

AI Testing & Monitoring

Overtracking

Privacy-friendly web analytics with goals, heatmaps and performance signals.

analyticsprivacyweb-performance
overtracking.comVisit

AI Testing & Monitoring

DeepEval

Open-source LLM evaluation framework with agent, RAG and conversational metrics.

evalstestingopen-source
deepeval.comVisit

AI Testing & Monitoring

Fiddler AI

AI observability and security platform for agents, LLM applications and predictive AI.

observabilitysecurityevals
fiddler.aiVisit

AI Testing & Monitoring

Galileo

AI evaluation and observability platform for testing and monitoring AI systems.

evalsobservabilityguardrails
galileo.aiVisit

AI Testing & Monitoring

Opik

Open-source AI observability and evaluation platform from Comet.

observabilityevalsopen-source
comet.comVisit

AI Testing & Monitoring

Portkey

AI gateway and observability stack for routing, governing and monitoring model traffic.

gatewayobservabilityrouting
portkey.aiVisit

AI Testing & Monitoring

Ragas

Open-source evaluation framework for RAG systems and AI applications.

evalsragopen-source
docs.ragas.ioVisit

AI Testing & Monitoring

Weights & Biases Weave

Toolkit for tracing, evaluating and improving LLM applications and agents.

evalsobservabilitytracing
wandb.aiVisit

AI Testing & Monitoring

Helicone

AI gateway and observability for production AI applications.

gatewayobservabilityrouting
helicone.aiVisit

AI Testing & Monitoring

Braintrust

Observability and evaluation for production AI agents

evalsobservabilitytracing
braintrust.devVisit

AI Testing & Monitoring

Traceloop

LLM observability and reliability platform

observabilitymonitoringtracing
traceloop.comVisit