Job Opportunities

Data Engineer - Data Integration Specialist

We are seeking a skilled Data Engineer Data Integration Specialist with strong expertise in enterprise data integration, centered on Microsoft Fabric and supported by the broader Microsoft Azure ecosystem.
The ideal candidate will have extensive experience extracting, transforming, and integrating data from multiple ERP systems and diverse data sources including databases, files, APIs, and analytical platforms. This role is critical in designing scalable, high-performance data pipelines, ensuring data accuracy and governance, and enabling advanced analytics and reporting initiatives across the organization.

Key Responsibilities:
Design, develop, and maintain scalable data pipelines using Microsoft Fabric (Data Factory, Lakehouse, Warehouse, Spark Notebooks).
Architect and implement robust ETL/ELT solutions for enterprise data integration.
Extract, transform, and integrate data from various ERP systems (e.g., SAP, Tally, Oracle, Microsoft Dynamics, or other enterprise platforms).
Ingest and integrate data from multiple sources including:
Relational databases (SQL Server, Oracle, MySQL, PostgreSQL)
Non-relational databases
Flat files (CSV, Excel, JSON, XML)
REST APIs and web services
Cloud and analytical platforms
Develop scalable data processing solutions using Python, PySpark, and SQL.
Build, optimize, and maintain data models within Microsoft Fabric Lakehouse and Warehouse environments.
Automate data extraction workflows and API integrations.
Implement data quality checks, validation frameworks, and monitoring processes.
Apply best practices in data governance, security, performance optimization, and documentation.
Collaborate with BI developers, analysts, architects, and business stakeholders to deliver reliable and high-quality data solutions.
Troubleshoot performance bottlenecks and optimize large-scale distributed data processing workloads.
Support CI/CD processes and deployment automation for data pipelines.
Work within the Azure data ecosystem when required (ADF, Synapse, ADLS, etc.).

Required Qualifications:
5+ years of hands-on experience in data engineering or data integration roles.
Hands-on experience with Microsoft Fabric (Data Factory, Lakehouse, Spark workloads, Warehouse) or demonstrated transition from Azure data services into Fabric.
Proven experience integrating data from ERP systems.
Experience integrating Microsoft Fabric with Azure-native services to support event-driven and serverless workflows (e.g., Azure Functions, Logic Apps, Durable Functions, Event Grid, Service Bus).
Advanced proficiency in: Python, SQL, PySpark
Strong understanding of ETL/ELT frameworks and modern data architecture.
Experience working with structured and semi-structured data.
Solid knowledge of data warehousing concepts and dimensional modeling (star schema, snowflake schema).
Experience processing and optimizing large-scale datasets in distributed environments.

Preferred Qualifications:
Familiarity with Power BI integration and downstream analytics enablement.
Understanding of data governance, security frameworks, and compliance best practices.
Experience working in cloud-native data environments.