Module 11

MLOps: CI/CD & Retraining

Build systems that improve safely: CI that tests data and models, and a retraining loop that rolls out a new model version without betting the whole system on it.

Sarah Floris Instructor Sarah Floris · Lead ML Engineer Coming soon

Included with Pro

Coming soon Not yet available

Automate safe model improvement

Monitoring that detects drift and decay

You arrive understanding the signals that detect input drift and model degradation in production, plus imbalance-aware metrics and baseline comparison. This module automates the response: tested pipelines, gated models, safe retraining.

drift detection metrics GitHub Actions

7 chapters

7 lessons

01 What This Module Covers

The arc of MLOps: CI/CD & Retraining: a CI pipeline that goes green on a clean machine, CI that tests the data and not just the code, a gate that blocks a model that does not beat baseline, a retraining loop that can poison itself, and a shadow-then-canary rollout that ships a new version without betting the whole system on it.

02 Get a CI Pipeline Going Green

Build a real CI pipeline that runs on every push, installs the locked deps, runs the tests, builds the artifact, and turns a clean machine's green check into evidence about your code.

03 Make CI Catch Bad Data

Test data as a second input, not just code: assert schema, types, ranges, and nullability at the boundary, and catch the leakage that makes a model look brilliant in validation and fail in production — the failure no code-only test suite can see.

04 Gate the Model and Version It

A green build does not mean a good model. Gate promotion on a metric that survives class imbalance rather than accuracy, and version the model as its artifact plus the data snapshot and seed that produced it — so it can be reproduced, audited, and rolled back.

05 Retraining: The Loop That Can Hurt You

Automatic retraining keeps a model up with drift and is also how it poisons itself: train on labels its own predictions influenced and each cycle gets worse while every metric looks fine. Build the loop with the guards that stop it degrading itself.

06 Roll Out Safely, and Keep It That Way

Ship a new model version without betting the whole system on it: shadow on the live stream, canary a bounded slice, then full, and standardize the path so months-long deploys stay three-day deploys.

07 What You Built in This Module

A recap of MLOps: CI/CD & Retraining: a pipeline that goes green only on a clean machine, CI that tests data and gates the model on the right metric, versioned reproducible models, a retraining loop with guards against self-poisoning, and a shadow-then-canary rollout — and what you have built across the whole track.

Ready to start?

This module is coming soon. Join the waitlist to be notified.

Coming soon Create account