Competera uses Big Data and Deep Learning to change the way retailers do pricing. We are known for both: cutting-edge math ’under the hood’ and for deep expertise in the pricing domain. We are now looking for a Senior Data Engineer to better the way our data processing works.
What you will do:
- Design, build, extend, and maintain data pipelines and unified integration ETL
- Scale the data pipeline throughput using applicable instruments
- Introduce and adopt new instruments, technologies and their combinations that will allow the company to scale the data processing speed and performance in a cost-efficient way
Starter-kit needed to join the board:
- Proven experience in building data processing pipelines
- Experience with workflow automation tools (AirFlow, Prefect, Luigi, etc.)
- RDBMS, Column-oriented DBMS (writing queries, db architecture building, administration, etc.)
- Apache Spark
- Strong core Python knowledge
Pleasant extras:
- ClickHouse
- Apache Kafka
- CDC (e.g. WAL->Debezium->Kafka)
- ksqlDB
- Spark SQL
- Argo Workflows
- GCP: BigQuery, Dataproc, Data Fusion, DataFlow
You’re gonna love it, and here’s why:
- Meaningful work in an agile team of engineers, who turn business ideas into software solutions
- Freedom to choose the best suitable technologies to deliver the solution (even if it’s not in the product yet)
- Want to learn? Competera loves that and is eager to cover 60% of your training/courses fee
- Fair payout with regular performance-based reviews and stock options plan for top performers
- Remote-first ideology even after the pandemic and the war
- Working hours that adapt to your biorhythm
- Paid vacation & sick leaves (20 business days each) + 15 days off
- Partial medical insurance coverage
Let’s price the world together!