Data Engineer - Temporary
| Branche | Zie onder |
| Dienstverband | Zie onder |
| Uren | Zie onder |
| Locatie | Utrecht |
| Opleidingsniveau | HBO / bachelor |
| Contactpersoon |
Shir Abramovich |
Informatie
As a Data Engineer on the Warehouse Data Availability team, you'll be an integral part of a collaborative unit including data and BI engineers, a lead engineer, a product manager, and an engineering manager. Your contributions will include:
- Architecting, developing, and sustaining data pipelines for extracting and transforming data from diverse warehouse systems.
- Leveraging Postgres and BigQuery as primary data repositories.
- Constructing and refining data transformations through the use of dbt.
- Managing and automating workflows utilizing Apache Airflow.
- Engineering robust and scalable processing solutions with GCP Dataflow.
- Producing clean, well-maintained SQL and Python code.
- Enhancing the performance, dependability, and detectability of current pipelines.
- Partnering with stakeholders to translate their data requirements into effective technical implementations.
Omschrijving
As a Data Engineer on the Warehouse Data Availability team, you'll be an integral part of a collaborative unit including data and BI engineers, a lead engineer, a product manager, and an engineering manager. Your contributions will include:
- Architecting, developing, and sustaining data pipelines for extracting and transforming data from diverse warehouse systems.
- Leveraging Postgres and BigQuery as primary data repositories.
- Constructing and refining data transformations through the use of dbt.
- Managing and automating workflows utilizing Apache Airflow.
- Engineering robust and scalable processing solutions with GCP Dataflow.
- Producing clean, well-maintained SQL and Python code.
- Enhancing the performance, dependability, and detectability of current pipelines.
- Partnering with stakeholders to translate their data requirements into effective technical implementations.
Functie eisen
- 5+ years of experience as a Data Engineer, preferrably within the warehouse, logistics, or operational data domains.
- Strong proficiency in SQL, encompassing data modeling, query optimization, and performance tuning.
- Postgres and BigQuery, or similar enterprise-grade data warehouses.
- Experience with data pipeline orchestration tools, specifically Airflow.
- Familiarity with data transformation tools, specifically dbt.
- Solid experience with Python for data manipulation, scripting, and automation.
- Experience with CI/CD pipelines.
- Experience with Java is highly preferred.
- Experience with GCP Dataflow or Apache Beam for building data processing pipelines.