Consultant
Primary Skills
- Spark – Pyspark, SQL, SQL (Basic + Advanced), Python, Hive, Data Modelling Fundamentals
Specialization
- Data Analysis: Data Engineer
Job requirements
- Job Title: Data Engineer Location: [Insert Location] Department: [Insert Department] Reports To: [Insert Manager Name] ________________________________________ Role Overview We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience in data modeling, ETL processes, and working with large datasets to enable analytics and business intelligence. ________________________________________ Key Responsibilities • Design, develop, and maintain data pipelines for ingestion, transformation, and storage. • Implement ETL processes to ensure data quality, consistency, and reliability. • Collaborate with data scientists, analysts, and business teams to understand data requirements. • Optimize data workflows for performance and scalability. • Manage and monitor data infrastructure (cloud/on-premise). • Ensure compliance with data governance, security, and privacy standards. • Troubleshoot and resolve data-related issues promptly. ________________________________________ Required Skills & Qualifications • Bachelor’s/Master’s degree in Computer Science, Engineering, or related field. • Strong proficiency in SQL and experience with relational databases. • Hands-on experience with Python/Scala/Java for data processing. • Familiarity with big data technologies (Hadoop, Spark, Kafka). • Experience with cloud platforms (AWS, Azure, GCP) and data services. • Knowledge of data modeling, warehousing, and architecture principles. • Understanding of CI/CD pipelines and version control (Git). ________________________________________ Preferred Skills • Experience with streaming data and real-time processing. • Knowledge of containerization (Docker, Kubernetes). • Exposure to machine learning pipelines and analytics tools. ________________________________________ Soft Skills • Strong problem-solving and analytical skills. • Excellent communication and collaboration abilities. • Ability to work in a fast-paced, dynamic environment.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Apply info ->
To apply for this job, please visit jobs.lever.co
