Embark on an exciting journey into the realm of data engineering and architecture with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. As a Data Architect you will be at the heart of the organization and support our clients to take control of their data and get value out of it by defining a reference architecture for our customers. This means that you will work closely with business leaders and information management teams to define and implement a roadmap on data architecture, data management, business intelligence or analytics solutions..

Minimum Qualifications:

• Translate business requirements into data requests, reports and dashboards.
• Strong Database & modeling concepts with exposure to SQL & NoSQL Databases
• Strong data architecture patterns & principles, ability to design secure & scalable data lakes, data warehouse, data hubs, and other event-driven architectures
• Expertise in designing and writing ETL processes in Python / Java / Scala
• Understanding of Hadoop framework – Exposure to PySpark, Spark, Storm, HDFS, Hive
• Strong hands-on experience with either Databricks or Snowflake; experience with both is desirable.
• Knowledge of Master Data management and related tools
• Strong exposure to data security and privacy regulations (GDPR, HIPAA) and best practices
• Skilled in ensuring data accuracy, consistency, and quality
• Experience with the AWS/Azure/GCP data engineering services
• Knowledge of AWS services viz., AWS S3, Redshift, Lambda, DynamoDB, EMR, Glue, Lakeformation, Athena, Quicksight, RDS, Kinesis, Managed Kafka, API Gateway, CloudWatch
• And / OR
• Knowledge of Azure services viz., ADF, Data Catalog, Databricks, Azure Synapse Analytics, ADLS Gen2, Azure Devops
• Ability to implement data validation processes and establish data quality standards.
• Experience in Linux
• Proficiency in data visualization tools like Tableau, Power BI or similar to create meaningful insights

Additional Experience Desired:

• Experience working with data ingestion tools such as Fivetran, stitch, or Matillion
• AWS IOT solutions
• Apache NiFi, Talend, Informatica
• Exposure to AI / ML technologies