Observability & Monitoring

knockknock

Knockknock is a simple Python library that allows developers to get notifications when their machine learning model trai...

Losswise

Losswise simplifies the process of monitoring and visualizing the performance metrics of your machine learning projects,...

MLNotify

MLNotify simplifies the monitoring of machine learning model training by sending notifications upon completion, eliminat...

Pastalog

Pastalog provides simple and real-time visualization for monitoring the performance of neural networks during training. ...

SafeGen_CCS2024

SafeGen is a tool designed to mitigate the generation of unsafe or inappropriate content in text-to-image models, enhanc...

ScreenPipe

ScreenPipe turns your computer into a personal AI that records everything you do, allowing you to search and automate ta...

SVM Explorer

SVM Explorer is an interactive tool for visualizing Support Vector Machines. It leverages Plotly's Dash framework and in...

Tracking AI

Tracking AI is a tool designed to monitor and mitigate biases within artificial intelligence chatbot systems. It helps e...

Weights and Biases

Weights and Biases is a tool for visualizing and tracking machine learning experiments. It helps data scientists and dev...

Genkitx-Langfuse

Genkitx-Langfuse is a plugin that integrates Langfuse observability tools into the Genkit AI framework, enabling develop...

Aim

Aim is an open-source tool for tracking and visualizing machine learning experiments. It simplifies the process of monit...

Arize

Arize provides a comprehensive solution for monitoring and observing machine learning models in production. It helps tea...

Arize-Phoenix

Arize-Phoenix is an open-source tool designed to monitor and fine-tune machine learning models, including LLMs, CV model...

Comet

Comet is an ML platform that helps users track experiments, hyper-parameters, artifacts, and more. It integrates with ov...

CometML

CometML offers comprehensive MLOps capabilities including experiment tracking, model production monitoring, a model regi...

DVClive

DVClive is a Python library that simplifies the process of tracking and logging experiment metrics by storing them in ea...

Fiddler AI

The all-in-one AI Observability and Security platform that helps enterprises operationalize ML, GenAI, and LLM applicati...

Guild.ai

Guild.ai is a tool to log, analyze, compare, and optimize machine learning experiments. It supports cross-platform opera...

Instrumentation Openai

This tool provides observability features for applications using the `openai` client library, enabling detailed monitori...

LLM Gateway

LLM Gateway Core is a main proxy server designed to facilitate communication between various language model services and...

MLflow Anthropic Integration

The mlflow-anthropic package provides integration capabilities between MLflow and Anthropic, enabling developers to trac...

Phoenix

Phoenix helps uncover insights, surface problems, monitor, and fine-tune generative LLMs, CV, and tabular models. It is ...

Radicalbit

Radicalbit is an open-source tool designed to monitor and ensure the performance of AI models once they are deployed int...

Soopervisor

Soopervisor is a tool that allows developers to export their machine learning projects into various workflow management ...

Superwise

Superwise provides fully automated observability for machine learning models in a self-service SaaS platform, enabling t...

Whylogs

Whylogs is an open-source library that enables developers to log and monitor their machine learning models' performance....

AnyChart

AnyChart is a powerful data visualization tool that provides interactive charts and graphs for web and mobile applicatio...

BetterStack

BetterStack is an uptime monitoring and incident management platform. It provides HTTP/TCP/cron monitoring with multi-lo...

Cronitor

Cronitor helps teams monitor and manage their cron jobs and scheduled tasks. It ensures that critical processes are runn...

ctrace

ctrace is a well-formatted tool that enhances the tracing of system calls and signals, making it easier to debug and und...

Fiddler

Fiddler provides comprehensive monitoring and analysis tools for AI models in production. It helps teams understand mode...

HealthchecksIO

HealthchecksIO is a simple tool for monitoring cron jobs. It helps ensure that scheduled tasks are running as expected b...

Heartbeat.pm

Heartbeat.pm is a monitoring tool designed to ensure that sensors and cron jobs are functioning as expected. It helps in...

Hermes Profile Transformer

The Hermes Profile Transformer converts profiling data from the Hermes JavaScript engine used in React Native for Androi...

hook-std

hook-std is a utility that allows developers to intercept and manipulate the standard output and error streams in Node.j...

Netdata

Netdata provides real-time monitoring and alerting with AI-driven insights to help developers and operations teams quick...

node-linux

Node-Linux allows developers to run Node.js scripts as native Linux system services, ensuring they start on boot and res...

pynput

Pynput is a library that allows for the control of mouse and keyboard inputs in Python, enabling developers to automate ...

Strong Log Transformer

Strong Log Transformer is a stream transformer designed to prefix log lines with timestamps and other contextual informa...

terminal-image

terminal-image is a tool that allows developers to display images within the terminal window. This can be useful for deb...