We are an international company with research and development centers in Israel and Ukraine. Our primary goal is to provide an innovative video e-commerce platform for the USA market. Currently, we are expanding our analytics team to enhance our platform and offer advanced AI-based analytics and recommendation data to support 1000 stores.
We are actively seeking an experienced Data Engineer to join our analytics team. In this role, you will take charge of managing and optimizing our data infrastructure. Your responsibilities will include designing and implementing scalable data pipelines, ensuring data quality and reliability, and collaborating closely with the data science team to facilitate efficient data analysis.
Requirements:
—
— Mandatory skills in Apache Hive, Apache Spark, Apache Airflow, Scala/Java, MySQL, S3, Apache Kafka, experience with Linux based operating systems, Ansible;
— Working knowledge of message queuing, stream processing systems;
— Experience in setting up data streaming pipelines (ETL, ELT);
— Familiarity with Druid, Python, Redis, Prometheus, Grafana, ELK is a plus;
— Certificates related to data engineering and contribution to Spark/Druid are a plus.
Responsibilities:
— Review the built system and suggest possible improvements in terms of code and configuration of Spark jobs;
— Architect and develop complex ETL/ELT processes for big data.
What we offer:
— Career planning and regular performance review;
— Flexible bonus system;
— Paid leave days;
— Free medical insurance;
— Sports reimbursement according to Company HR Policies;
— English lessons and speaking club;
— Support in the maintenance of all documentation for private entrepreneurs.