Job Opportunities

DATA ENGINEER (AZURE & MICROSOFT FABRIC)

Job Title: Data Engineer (Azure & Microsoft Fabric)
Work Location: Infopark, Kochi
Experience Required: 4 to 5 Years
Employment Type: Full-Time, Permanent
Work Mode: Onsite, Hybrid
Shift: Regular Shift

Company Description: SparkSupport Infotech Pvt Ltd, a leading IT solutions provider based in India, has joined forces with Tible, Netherlands, in a strategic joint venture to enhance our service offerings and expand our global footprint. For over 24 years, SparkSupport has been a trusted offshore technology partner for businesses in the UAE, UK, US, Netherlands, Canada and other regions. We specialize in delivering scalable web and mobile applications, end-to-end cloud computing solutions, DevOps, data analytics, and Power Platform services. At SparkSupport, you will be part of a passionate team committed to solving tough technology challenges with innovative solutions, strengthened by our global partnership.

Role Description: We are seeking a highly skilled Data Engineer (Azure & Microsoft Fabric) with 4–5 years of experience in building scalable and efficient data engineering solutions using Microsoft Azure and Microsoft Fabric technologies. The ideal candidate should have strong expertise in ETL/ELT development, Azure Data Factory, Microsoft Fabric, advanced SQL, Data Lake architecture, and enterprise data pipeline orchestration.
The role involves designing and implementing modern cloud-based data platforms, building robust ingestion frameworks including watermark/incremental loading, and enabling analytics and reporting solutions across the organization.

Key Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines using Microsoft Azure services and Microsoft Fabric.
• Implement watermark-based, incremental loading, and CDC (Change Data Capture) mechanisms for optimized data ingestion and processing.
• Develop and orchestrate end-to-end data workflows using Microsoft Azure Data Factory (ADF) and Fabric Pipelines.
• Build and manage enterprise-scale data pipelines for structured, semi-structured, and unstructured data.
• Design and implement Lakehouse and Data Warehouse solutions using Microsoft Fabric.
• Work with OneLake architecture for centralized and governed enterprise data management.
• Implement medallion architecture (Bronze, Silver, Gold layers) for scalable data transformation and analytics.
• Develop and optimize Spark and SQL-based data transformations within Fabric environments.
• Design, manage, and optimize Azure Data Lake solutions.
• Write and optimize complex SQL queries, stored procedures, views, and performance tuning scripts.
• Integrate data from multiple cloud and on-premise data sources.
• Monitor, troubleshoot, and optimize pipeline execution, workload performance, and data quality.
• Implement security, governance, lineage, and access controls across data platforms.
• Collaborate with business analysts, BI developers, architects, and stakeholders to deliver data-driven solutions.
• Support CI/CD implementation, Git integration, and deployment automation for data engineering projects.

Required Skills & Qualifications:

 Mandatory Skills
Microsoft Azure & ETL
• 4–5 years of experience in Data Engineering.
• Strong hands-on experience in:
 ETL/ELT development using Azure technologies
 Microsoft Azure Data Factory (ADF)
 Azure Data Lake
 Data pipeline orchestration
 Advanced SQL programming
• Experience implementing:
 Watermark-based loading
 Incremental data processing
 CDC frameworks
 Batch and near real-time data ingestion
• Strong understanding of:
 Data warehousing concepts
 Data modeling
 Data transformation frameworks
 Performance optimization techniques
 Microsoft Fabric Skills
• Strong hands-on experience with:
 Fabric Data Factory
 Fabric Lakehouse
 Fabric Warehouse
 OneLake
 Fabric Pipelines
 Dataflows Gen2
 Fabric Notebooks
• Experience designing modern analytics and enterprise data solutions using Microsoft Fabric.
• Strong understanding of:
 Medallion Architecture
 Delta Tables
 Parquet file formats
 Data partitioning
 Incremental processing
 OneLake shortcuts
• Experience integrating:
 Power BI with Fabric Semantic Models
 Azure services with Fabric ecosystem
 SQL databases, APIs, and external data sources
• Experience optimizing Spark jobs and SQL transformations in Fabric environments.
 Preferred Skills
• Experience with:
 PySpark
 Python
 Azure Synapse Analytics
 Power BI
 Git and CI/CD pipelines
• Knowledge of:
 Fabric administration and tenant settings
 Workspace security and governance
 Row-Level Security (RLS)
 Data lineage and monitoring
 Agile/Scrum methodologies

Educational Qualification:

 Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field.

Soft Skills

 Strong analytical and problem-solving skills.
 Excellent communication and stakeholder management abilities.
 Ability to work independently and collaboratively in a fast-paced environment.
 Strong attention to detail and commitment to data quality and governance.

Nice to Have

 Microsoft Azure or Microsoft Fabric certifications.
 Experience working on enterprise-scale cloud data platforms.
 Exposure to Real-Time Analytics/Eventstream capabilities in Microsoft Fabric.