Skip to main content

CI/CD Dashboard

Live operations view for the Wasteology data platform. Shows real-time health across Prefect ingestion pipelines and the dbt production pipeline in a single glance.

Page Overview

CI/CD Dashboard

Monitor ingestion health and dbt pipeline status with color-coded status tiles and environment indicators

Screenshot of CI/CD Dashboard

How to Use

1Check Prefect ingestion health tiles for each source group
2Review dbt pipeline health, current streak, and environment status
3Expand manual promotion controls to promote dbt changes between environments
4Use the refresh button to force a cache update

Features

🔄

Ingestion Health

Color-coded status tiles per source group show whether recent Prefect runs are healthy, degraded, or failing

🔗

dbt Pipeline Health

Daily run history with current consecutive-success streak and last-run timestamp

🌐

Environment Status

Dev, QA, and Prod environment indicators for the dbt Cloud project

🚀

Manual Controls

Collapsed promotion panel — expand to trigger dbt promotions between environments without leaving Palantiri

Prefect Ingestion Health

The top section of the page groups Prefect flow runs by source group and renders a color-coded tile for each.

Source Groups

Source GroupFlows Covered
CieTradecietrade-* prefix flows
Enevoenevo-* prefix flows

Tile Colors

ColorMeaning
GreenAll recent runs in this group succeeded
AmberSome runs failed but latest run succeeded
RedLatest run failed — intervention may be needed
note

The status reflects runs within the configured lookback window (default 168 h / 7 days). A source group with no runs in that window shows as amber with a "No recent runs" label.

dbt Pipeline Health

The bottom section tracks the dbt production pipeline operated via dbt Cloud.

MetricDescription
Current StreakConsecutive days with a successful dbt prod run
Daily Run HistorySparkline of pass/fail per day over the last 30 days
Last RunTimestamp and state of the most recent dbt prod job
Environment StatusPer-environment (Dev / QA / Prod) last-run state badge

Environment Status Badges

EnvironmentBadge
DevDevelopment
QAQA
ProdProduction

Manual Promotion Controls

Expand the Manual Promotion panel (collapsed by default) to promote dbt changes between environments.

warning

Manual promotions bypass the normal ADO CI gate. Use only when you need an out-of-cycle promotion and coordinate with the team first.

The panel exposes the following actions:

  • Dev → QA: promotes the current dev state to QA for testing
  • QA → Prod: promotes QA-validated changes to the production environment

Data Refresh

The dashboard caches data for 2 minutes to avoid hammering the Prefect API and dbt Cloud on every page load. Use the Refresh button in the top-right corner of each section to force an immediate cache bust.