About Brillio:

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.

Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio’s relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.

Data Engineer

Job Description

• We are seeking a highly skilled Data Engineer with hands-on experience in building and managing robust data pipelines and platforms using modern data stack technologies. The ideal candidate will have expertise in ETL processes, strong SQL skills, and a deep understanding of cloud-based data engineering tools, particularly on Google Cloud Platform (GCP).
• Key Responsibilities:
• Design, develop, and maintain scalable ETL pipelines for structured and unstructured data.
• Write and optimize complex SQL queries (Basic + Advanced) to support analytics and reporting.
• Work with Google Big Query for data warehousing, transformation, and performance optimization.
• Develop distributed data processing solutions using Dataproc, Dataflow, and Data Fusion .
• Orchestrate data workflows using Cloud Composer (Airflow).
• Implement logging and monitoring using Cloud Trace, Cloud Logging, and Cloud Storage .
• Build and maintain metadata repositories with Data Catalog for effective data governance.
• Apply strong data modelling fundamentals for designing normalized and denormalized data structures.
• Collaborate with cross-functional teams to implement modern data platform fundamentals .
• Write and manage stored procedures using PLSQL, T-SQL, and other scripting tools.
• Leverage Python for scripting, automation, and data manipulation tasks.
• Ensure data quality, accuracy, and performance across all data platforms.
• Required Skills:
• Strong understanding of ETL fundamentals and modern data engineering principles.
• Expertise in SQL (both basic and advanced), PLSQL, and T-SQL.
• Experience with Google Cloud Platform services: BigQuery, Dataflow, Dataproc, Data Fusion, Cloud Composer, Cloud Trace, Cloud Logging, Cloud Storage, Data Catalog .
• Proficiency in Python for data engineering tasks and automation.
• Solid understanding of data warehousing and data modelling practices.
• Experience building pipelines in a modern data platform environment.
• Preferred Qualifications:
• GCP certification (e.g., Professional Data Engineer or equivalent). Experience with CI/CD practices in data engineering.
• Familiarity with other cloud platforms (AWS, Azure) is a plus.
• Exposure to data security and governance practices.
• Know more about DAE: https://www.brillio.com/services-data-analytics/
• Know what it’s like to work and grow at Brillio: https://www.brillio.com/join-us/
• Equal Employment Opportunity Declaration
• Brillio is an equal opportunity employer to all, regardless of age, ancestry, color, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.

$0 – $0 an hour

Know what it’s like to work and grow at Brillio: Click here