Embark on an exciting journey into the realm of software product development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Lead, Data Engineering, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🌍🔥

Job Description

• Lead the design, development, and implementation of scalable data engineering solutions on the Azure platform.
• Architect and manage enterprise data platforms using Azure Data Lake (ADLS Gen2) and Microsoft Fabric (Lakehouse, Data Factory, Synapse, Power BI)
• Design and optimize ETL/ELT pipelines for structured and unstructured data using Azure-native tools.
• Build and maintain data ingestion, transformation, and orchestration pipelines using Azure Data Factory / Fabric Data Pipelines.
• Ensure data quality, security, governance, and compliance across data platforms.
• Collaborate with data scientists, analysts, and business stakeholders to deliver analytics-ready datasets.
• Lead and mentor junior data engineers, providing technical guidance and best practices.
• Optimize performance, cost, and scalability of data workflows and storage solutions.
• Implement CI/CD pipelines and follow DataOps best practices for deployment and monitoring.
• Troubleshoot production issues and drive continuous improvement across data systems.

Required Skills & Qualifications

• 10+ Years of Experience in IT Industry
• 6+ years of experience in Data Engineering, with strong expertise in Azure Data Platform.
• Hands-on experience with Azure Data Lake (ADLS Gen2) and Microsoft Fabric.
• Strong proficiency in SQL and Python for data processing and transformation.
• Experience with Azure Data Factory, Fabric Lakehouse, Synapse, and Power BI.
• Solid understanding of data warehousing concepts, data modeling, and big data processing.
• Experience implementing data security, access control, and governance in Azure.
• Familiarity with CI/CD, DevOps, and version control (Git).
• Excellent communication and leadership skills with experience leading technical teams.

Good to Have

• Azure certifications (Azure Data Engineer Associate, Fabric certifications).
• Experience with real-time data processing (Event Hub, Stream Analytics).
• Exposure to cloud cost optimization and performance tuning.

Regards

Rajan Paul( Linkedin Profile )

Talent Acquisition

3Pillar Global