Lead Big Data Engineer

last updated April 5, 2021 23:10 UTC

AdRoll

HQ: Remote

more jobs in this category:

  • -> Website & App Tester @ PingPong
  • -> Entry Level Content Writer @ Jerry
  • -> Code Challenge Reviewer - Review Code In Your Spare Time - £50 Per Hour @ Geektastic
  • -> Frontend Developer (React) @ Cake
  • -> Frontend Engineer @ Torc

About the Role:

AdRoll’s data infrastructure processes 100TB of compressed data, 4 trillion events, and 100B real time events daily on a scalable, highly available platform. As a member of the data & analytics team, you will work closely with data engineers, analysts, and data scientists to develop novel systems, algorithms, and processes to handle massive amounts of data using languages such as Python and Java.

Responsibilities:

  • Develop and operate our data pipeline & infrastructure

  • Work closely with analysts and data scientists to develop data-driven dashboards and systems

  • Tackle some of the most challenging problems in high-performance, scalable analytics

  • Available for after hour issues and the ability to be on call, but aiming incessantly to reduce after hours incidents

  • Communicate with Product and Engineering Managers

  • Mentor Junior Engineers on the team

Qualifications:

  • A BS or MS degree in Computer Science or Computer Engineering, or equivalent experience

  • 4-6 years experience, atleast 2 of which include leading teams

  • Experience with scalable systems, large-scale data processing, and ETL pipelines

  • Experience with big data technologies such as Hadoop, Hive, Spark, or Storm

  • Experience with NoSQL databases such as Redis, Cassandra, or HBase

  • Experience with SQL and relational databases such as Postgres or MySQL

  • Experience developing and deploying applications on Linux infrastructure

Bonus Points:

  • Knowledge of Amazon EC2 or other cloud-computing services

  • Experience with Presto (prestodb.io/)

Compensation:

  • Competitive salary and equity

  • Medical / Dental / Vision benefits

  • Paid time off and generous holiday schedule

  • The opportunity to win the coveted Golden Bagel award

Shopping Cart
There are no products in the cart!
Total
 0.00
0