HiringCafe
Posted 4mo ago

Senior Data Engineer - Microsoft Azure Fabric

@ Accellor
View All Jobs
Hyderabad, Telangana, India
OnsiteFull Time
Responsibilities:Design pipelines, Develop notebooks, Build architectures
Requirements Summary:Total experience 5+ yrs with 2+ yrs in data fabric; Microsoft Fabric expertise; Python, PySpark, Pandas, Polars; REST API; Delta Lake/Iceberg; Spark/SQL optimization; Azure DevOps; CI/CD; data modeling.
Technical Tools Mentioned:Python, PySpark, Pandas, Polars, REST API, Delta Lake, Iceberg, Spark, SQL, Visual Studio Code, Azure DevOps, Microsoft Fabric
Save
Mark Applied
Hide Job
Report & Hide
Job Description

We are seeking an experienced Senior Data Engineer to design, develop, and optimize data solutions using Microsoft Fabric. This role requires deep technical expertise in modern data engineering practices and Microsoft's unified analytics platform.  Similar experience with Data Bricks would be considered.

Key Responsibilities:

  • Design and implement scalable data pipelines and ETL/ELT processes within Microsoft Fabric from a code-first approach
  • Develop and maintain notebooks, data pipelines, workspace  and other Fabric item configurations
  • Build and optimize data architectures using delta tables, lakehouse, and data warehouse patterns
  • Implement data modelling solutions including star schema, snowflake schema, and slowly changing dimensions (SCDs)
  • Performance tune Delta, Spark, and SQL workloads through partitioning, optimization, liquid clustering, and other advanced techniques
  • Develop and deploy Fabric solutions using CI/CD practices via Azure DevOps
  • Integrate and orchestrate data workflows using Fabric Data Agents and REST APIs
  • Collaborate with development team and stakeholders to translate business requirements into technical solutions