Job Responsibilities

• Make sure our infrastructure stays up and running 24/7.

• Repair nodes as they fail and deploy new hardware as we scale our infrastructure.

• Perform task related to deploying new software, managing DNS, maintaining OS security patches, etc.

• We have an existing infrastructure that you will be managing for the next 90 days as we transition to our new stack.

• Deploy new systems and scale our infrastructure as we expand our capacity for more content and customers.

Ideal Candidate

This position can be located anywhere in the world with ideally at least a 4 houroverlap with the Pacific Standard Time Zone (PST / UTC-8). We’re based out of San Francisco but are migrating to the international level. If you don’t have a natural time overlap with UTC-8 you should be willing to work evenings to be able to communicate easily with the rest of the team.

Culturally, we’re a remote company and want to embrace it as a way to reward our employees.We are fine with you working in remote locations as long as you’re generally available for communication and are productive.

The plan is to transfer all operations management to you, including being on call for outages, and knowing our operations tasks including bringing up new machines, dealing with failures, etc.

We want someone to come in full time as a contractor role. I suspect we will need about 40 hours from you per week.

Architecture:

Our infrastructure consists of Java on Linux (Debian/Ubuntu) with the stack running on ActiveMQ, Cassandra, Zookeeper, and Jetty. We use Ansible to manage our boxes. We have a full-text search engine based on Elasticsearch and store our firehose API data within Cassandra.

We have a totally new stack and infrastructure at this point. We recently did a full-stack rewrite and moved all the old code to our new infrastructure. This means we have very little legacy cruft to deal with.

Here’s all the cool stuff you get to play with:

• Large Linux / Ubuntu cluster running with the OS versioned using both Ansible and our own debian packages for software distribution.

• Massive amount of data indexed from the web and social media. We index from 5-20TB of data per month and want to expand to 100TB of data per month.

• Large Cassandra install on SSD.

• SOLR / Elastic Search migration / install. We’re experimenting with bringing this up now so it would be valuable to get your feedback.

Compensation:

• Salary based on experience. We’re willing to be competitive and a great company to work for.

• Ability to work remotely at home. Live work balance is a must.