Big Data Engineer

last updated April 15, 2025 0:22 UTC

The Shelf

more jobs in this category:

  • -> Website & App Tester @ PingPong
  • -> Entry Level Content Writer @ Jerry
  • -> Code Challenge Reviewer - Review Code In Your Spare Time - £50 Per Hour @ Geektastic
  • -> Frontend Developer (React) @ Cake
  • -> Frontend Engineer @ Torc

We’re looking for a data nerd with an engineering bent who enjoys incorporating messy and varied data sets into a clean and efficient data analysis pipeline. Wranging with data to find meaningful insights is what drives you to work every day. You are relentless in getting things done. You don’t need parental supervision (i.e., you don’t like to be micro-managed). You want to take ownership of the code/features you’re building.

Must have: Deep understanding of CS fundamentals as well as distributed systems

  • At least 5 years of experience building production level software (Python, Django required)
  • At least 2 years in a big-data related role at a data-driven company
  • Continuous integration and deployment experience

Experience: you should have experience fetching, processing, and analyzing data in Python:

  • Experience developing and maintaining the back-end of a data-driven web app
  • Extensive experience with web-scraping (deep knowledge of Selenium a plus)
  • Experience implementing a data collection and analysis pipeline, scaling up to larger data sets and optimizing as necessary
  • Experience working with (non-)relational databases, particularly MongoDB
  • (Not necessary but we’d love you if) Experience with general data mining (NLTK) and machine learning techniques
  • (Not necessary but we’d love you if) Understanding and experience maintaining & optimizing PostgresSQL database is a major plus

Our Stack : Python + Django Amazon EC2, RDS (Postgres), Rackspace, RabbitMQ for messaging, Celery for queues

$70,000 — $120,000/year

Shopping Cart
There are no products in the cart!
Total
 0.00
0