Data Science and Analytics · Remote

Intermediate Data Engineer

AB InBev | Growth Group · Remote · Posted Sep 16, 2024

This posting comes from AB InBev | Growth Group. Confirm the details on their site before applying.

Overview

www.abinbev.com

Responsibilities

  • Implement ETL/ELT solutions and data integration between multiple systems and data sources.
  • Design, implement, and maintain data pipelines to ingest, store, and process large volumes of data.
  • Collaborate with other teams to ensure data security and compliance.
  • Design, develop, and implement solutions to optimize the performance and scalability of data processing systems.

Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Systems Analysis and Development, or similar;
  • Intermediate English;
  • Apply knowledge of data pipeline concepts and tools to implement data transformation, cleaning, and aggregation tasks.
  • Use data pipeline frameworks and libraries to automate data processing tasks and optimize workflows.
  • Follow best practices for developing data pipelines, including version control, testing, and thorough documentation.
  • Apply programming skills in Python, PySpark, Scala, and SQL to effectively manipulate and transform data.
  • Understand and utilize cloud computing platforms and services offered by providers such as AWS, Azure, and Google Cloud.
  • Develop data pipelines using orchestration frameworks (e.g., Apache Airflow, Luigi, Mage, Databricks Workflows), integrating with PySpark and/or Scala as needed.
  • Understand and apply software design principles to data engineering projects.
  • Apply data modeling techniques to design efficient and scalable data models.
  • Optimize PySpark and SQL query performance, considering data volume, query complexity, and system resources.
  • Use data tools for ingestion, transformation, analysis, and visualization.
  • Logical reasoning and analytical skills;
  • Meeting deadlines and delivering quality work;
  • Effective and transparent communication with other teams and coworkers;

Benefits

  • Performance-based bonus*
  • Attendance bonus*
  • Private pension plan
  • Meal allowance
  • Casual office and dress code
  • Days off*
  • Health, dental, and life insurance plans
  • Discounts on medications
  • Partnership with WellHub
  • Childcare assistance
  • Discounts on Ambev products*
  • Clube Ben partnership

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.