We are looking for a data engineer to migrate our existing ETL workflows to Google BigQuery. We want to optimize our data handling processes to increase efficiency and scalability for any data aggregation tasks. This role requires someone with a deep understanding and experience with big query, data pipeline optimization and testing.
We are in the process of evaluating what cloud database to go with. Currently, we’re using postgres and TimescaleDB extension. We have a custom incremental materialized view-like system where we have a table with raw source data (flattened JSON object). We had prior queries written to create build tables that represent the final version of the aggregated data. Long story short, the issue is that the build takes a very long time and functions un-useable.
Deadline is set for 2 weeks.
- A self-starter.
- Ability to work remotely with no minimal supervision.
- Meticulous attention to detail and a passion for delivering high-quality work.
- Willingness to take short-term PAY for long-term gain.
- Ability to work in the PST timezone.
To apply for this job, please visit 81u1y9ciz0d.typeform.com