StepRight - Integration Testing, Packaging and Deployment

Every pipeline, job, and dashboard StepRight has built so far exists only in dev, deployed by hand. This closing section packages the whole project as a Databricks Asset Bundle, adds the integration tests that verify a real deployment (not just isolated logic) works end to end, and automates the entire dev -> uat -> prod promotion path through CI/CD – so that shipping a change to production is a reviewed pull request and one approval click, not a checklist of manual commands.

flowchart TD
    Bundle[databricks.yml +<br/>resources/*.yml] --> Bind[Bind existing dev resources]
    Bind --> DevDeploy[deploy --target dev]
    DevDeploy --> UnitCI[CI: unit-tests<br/>every PR]
    UnitCI --> Merge[Merge to main]
    Merge --> UatDeploy[CI: deploy --target uat<br/>+ bootstrap]
    UatDeploy --> IntTests[CI: integration-tests<br/>real uat pipeline run]
    IntTests --> Gate
    Gate --> ProdDeploy[CI: deploy --target prod<br/>+ smoke test]
    ProdDeploy --> Live[First production run]

Lectures


| ← Previous: Setup a Real Time Data Quality Monitoring and Alert | Next: Package your project using Declarative Automation Bundle → | |:—|—:|


Table of contents


Back to top

Independent, self-authored Databricks companion notes.

This site uses Just the Docs, a documentation theme for Jekyll.