Posted 5mo ago

Data Engineer (Madrid, Spain)

@ Unit8
Madrid, Community of Madrid, Spain
HybridFull Time
Responsibilities:Design pipelines, Maintain systems, Collaborate stakeholders
Requirements Summary:Proficient software engineer with Python, experience building distributed data pipelines, knowledge of data governance, strong client-facing skills, travel up to 15%, English mandatory and Spanish.
Technical Tools Mentioned:Python, Spark, Docker, AWS, EKS, CloudFormation, Databricks, PySpark, Data Factory, Azure, Proprietary Data Processing Platform
Save
Mark Applied
Hide Job
Report & Hide
Job Description

Who We Are

Founded in 2017, Unit8 is a fast-growing European AI and data analytics consulting and services company dedicated to solving complex problems of traditional industries like automotive, chemical, financial services, manufacturing and pharma. We work with some of the biggest organisations in Europe to solve the challenges that directly affect their business - be it operations, finance, manufacturing or R&D. Since our foundation, we have successfully delivered more than 350 projects and have grown to 170+ talented individuals across 9 office locations in Germany, Switzerland, Poland, Spain, US, and Middle East

Unit8’s mission is to drive the adoption of AI and Data Science in the non-digital industries and to help accelerate their digital transformation. Among its activities, Unit8 dedicates a part of its resources and time on projects that deeply matter to us - that includes collaboration on pro-bono and “engineering for good” causes. You can learn more about what we are passionate about at Unit8 Talks and on our website you can find more useful information about our business and recruiting process.


These are some examples of projects that we have been working on

  • Building a real-time production line monitoring system for the pharmaceutical industry to improve manufacturing throughput. Technologies: AWS, EKS, CloudFormation, Docker, Python
  • Building system for calculating and delivering global climate scores i.e. estimating the impact of climate change on the risk of natural disasters (i.e. floods, wildfires & droughts) for the Insurance Industry. Technologies: PySpark, Python, Proprietary Data Processing Platform
  • Building a modern data science platform including a data lake for Chemical Industry. Technologies: Azure, ML Studio, Data Factory, Databricks, Spark

What You’ll Do

Unit8 is growing at a fast pace and your role can evolve and will depend on our clients’ challenges. As a member of agile project teams, your mission will be to build solutions and infrastructure aiming at solving business problems of our clients.

In general, you will:

  • Design, build, maintain, and troubleshoot data pipelines and processing systems that are relied on for both production and analytics applications, using variety of open-source and closed-source technologies .
  • Help drive optimization, testing and tooling to improve data quality.
  • Collaborate with other software engineers, ML experts and stakeholders, taking learning and leadership opportunities that will arise every single day.
  • Work in multi-functional agile teams to continuously experiment, iterate and deliver on new product objectives.
  • Interact with our clients to understand their data-related challenges and related tech and business questions they need to answer.