Data Science and Analytics · Bengaluru, India

AWS Data Engineer

Capco · Bengaluru, India · Posted Nov 20, 2026

This posting comes from Capco. Confirm the details on their site before applying.

Overview

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

Requirements

  • Design, develop, test, and maintain scalable data pipelines and transformation workflows using Databricks.
  • Build and optimise data processing solutions using Apache Spark, PySpark, and SQL.
  • Develop batch and, where required, streaming data pipelines to support enterprise data processing requirements.
  • Implement robust data ingestion, cleansing, transformation, and enrichment processes across multiple data sources.
  • Develop and maintain Delta Lake tables, applying appropriate data modelling, partitioning, and optimisation strategies.
  • Implement reusable, modular, and maintainable data engineering frameworks and components.
  • Ensure data pipelines meet agreed performance, reliability, scalability, and quality standards.
  • Contribute to the design and implementation of cloud-based data platforms and lakehouse architectures.
  • Apply Medallion Architecture principles, including Bronze, Silver, and Gold data layers, where appropriate.
  • Optimise Spark workloads through efficient transformations, query tuning, cluster configuration, and resource management.
  • Implement appropriate data storage, partitioning, and data lifecycle management strategies.
  • Monitor and troubleshoot data processing workloads, identifying performance bottlenecks and implementing improvements.
  • Support the implementation of secure and scalable data platform solutions aligned with enterprise architecture standards.
  • Design and develop data ingestion and integration pipelines connecting structured, semi-structured, and unstructured data sources.
  • Implement data orchestration workflows using Databricks Workflows, AWS, or equivalent technologies.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.