Staff Software Engineer - Databases

Databricks · Bengaluru, India · Posted 1 month ago

About this role

P-375 At Databricks, we build powerful infrastructure that accelerates innovation and enables data teams to deliver with confidence and scale. Our unified schema migration platform underpins automated, observable, and developer-friendly workflows—ensuring Databricks can continue evolving rapidly across thousands of databases and 60+ mission-critical services. What You’ll Do As a Staff Software Engineer, you’ll lead the design, development, and reliability of our global platform that manages schema and data changes at scale: Schema Migration Platform: Architecting and maintaining automated schema change infrastructure for MySQL and TiDB, while implementing versioning, rollback, validation, and auditing for safe, predictable, and fast migrations. Scale, Reliability Test Harness: Ensuring the platform operates across thousands of global databases with zero downtime, enhancing resilience, observability, and recovery, and building a test harness for migration and deployment validation. Developer Experience CI/CD Integration: Designing intuitive tools and APIs for seamless schema and data change management, and embedding migration workflows into CI/CD pipelines to increase velocity and reduce friction. Schema Data management: Designing infrastructure for safe, large-scale schema and data operations like backfills and purging. This includes ensuring backfill operations are monitored, retryable, minimally disruptive, and automated to align with schema/data evolution and maintain data