CML

What it is

CML is a library that enables continuous integration in machine learning projects by leveraging GitHub Actions and GitLab CI. It automates the training, evaluation of models, and generates visual reports directly within pull/merge requests.

CML stands out by providing a framework-agnostic solution for automating ML model evaluation and reporting directly within CI/CD workflows, making it ideal for teams that prioritize consistency across different development stages.

When it fits — and when it doesn’t

Known weaknesses

Each one links to the public issue, changelog or docs page it came from, where we have one.

1. 01

   Limited integrations with non-GitHub/GitLab CI/CD systems

   Primary integration is GitHub Actions and GitLab CI, other CI systems are not officially supported

2. 02

   Performance issues with large datasets or complex models

   CI environments may have resource constraints that limit the speed and efficiency of model training and evaluation

What it does well

• Framework and language agnostic

• Automates model training and evaluation in CI environments

• Generates visual reports with metrics and graphs directly in pull/merge requests

Pricing

Free tier

YesOpen source — free to use

Paid from

$0

Model

Flat rate

Enterprise plan

No

Pricing not independently confirmed — check the vendor’s page.