Data Engineer - API & Platform Integration

Mahindra · Mumbai, Maharashtra

About this role

To strategically lead and support the API and data engineering function, enabling secure, scalable, and high-performance integration and data processing capabilities across the organisation. This role is responsible for hands-on design, development, and deployment of APIs and data pipelines using modern technologies such as FastAPI, REST APIs, Databricks, and SQL while leveraging containerisation and cloud-native platforms including Docker, Azure Container Apps (ACA), and AKS. The role ensures seamless data movement and transformation through tools like Azure Data Factory (ADF) or equivalent, aligns API-led integration and data engineering initiatives with business and digital priorities, and provides expert guidance on microservices architecture, data platforms, and best practices within a scalable Lakehouse ecosystem. Responsibilities: • Design, develop, and maintain API-led integration solutions and data engineering pipelines to support business applications. • Build and enhance scalable REST APIs using frameworks such as FastAPI, ensuring high performance and reliability. • Develop and optimise data processing workflows using Databricks (PySpark, SQL) for efficient data transformation and analytics. • Collaborate with business and technical teams to understand requirements and translate them into robust API and data solutions. • Implement containerised applications using Docker and deploy/manage services on cloud platforms such as Azure Container Apps (ACA) and AKS. • Dev