StepRight - Integration Testing, Packaging and Deployment
Every pipeline, job, and dashboard StepRight has built so far exists only in dev, deployed by
hand. This closing section packages the whole project as a Databricks Asset Bundle, adds the
integration tests that verify a real deployment (not just isolated logic) works end to end, and
automates the entire dev -> uat -> prod promotion path through CI/CD – so that shipping a
change to production is a reviewed pull request and one approval click, not a checklist of manual
commands.
flowchart TD
Bundle[databricks.yml +<br/>resources/*.yml] --> Bind[Bind existing dev resources]
Bind --> DevDeploy[deploy --target dev]
DevDeploy --> UnitCI[CI: unit-tests<br/>every PR]
UnitCI --> Merge[Merge to main]
Merge --> UatDeploy[CI: deploy --target uat<br/>+ bootstrap]
UatDeploy --> IntTests[CI: integration-tests<br/>real uat pipeline run]
IntTests --> Gate
Gate --> ProdDeploy[CI: deploy --target prod<br/>+ smoke test]
ProdDeploy --> Live[First production run]
Lectures
| # | Lecture | Est. Read |
|---|---|---|
| 1 | Package your project using Declarative Automation Bundle | 18 min read |
| 2 | Define your Automation Bundle Resources and Setup Job | 13 min read |
| 3 | Test Your Deployment Bundle in Dev Environment | 12 min read |
| 4 | Planning and Designing Integration Testing Approach | 6 min read |
| 5 | Developing your Integration Test for the UAT | 20 min read |
| 6 | Develop and Trigger Your CI/CD Pipeline for Deployment and Integration Testing | 19 min read |
| 7 | Final Stage - Production Deployment and Smoke Testing Your Project | 10 min read |
| ← Previous: Setup a Real Time Data Quality Monitoring and Alert | Next: Package your project using Declarative Automation Bundle → | |:—|—:|
Table of contents
- Package your project using Declarative Automation Bundle
- Define your Automation Bundle Resources and Setup Job
- Test Your Deployment Bundle in Dev Environment
- Planning and Designing Integration Testing Approach
- Developing your Integration Test for the UAT
- Develop and Trigger Your CI/CD Pipeline for Deployment and Integration Testing
- Final Stage - Production Deployment and Smoke Testing Your Project