Data Engineer Tech Lead/Team Lead (вакансія неактивна)

Looking for a Lead Data Engineer to join the Dataforest team. If you are looking for a friendly team, a healthy working environment, and a flexible schedule ‒ you have found the right place to send your CV.

As a Team Lead, you will be an expert and a leader, playing a crucial role in guiding the development team, making technical decisions, and ensuring the successful delivery of high-quality software products.

Skills requirements:

• Previous experience in a Team Lead role;
• 5+ years of experience with Python;
• 4+ years of experience as a Data Engineer;
• Knowledge of data algorithms and data structures is a MUST;
• Excellent experience with Pandas;
• Excellent experience with SQL DB / NoSQL (Redis, Mongo, Elasticsearch) / BigQuery;
• Experience Apache Kafka, Apache Spark (pyspark);
• Experience with Hadoop;
• Familiarity with Amazon Web Services;
• Understanding of cluster computing fundamentals;
• Working with high volume tables 100m+.

Optional skills (as a plus):

• Experience with scheduling and monitoring (Databricks, Prometheus, Grafana);
• Experience with Airflow
• Experience with Snowflake, Terraform;
• Experience in statistics;
• Knowledge of DS and Machine learning algorithms.

Key responsibilities:

• Manage the development process and support team members;
• Conduct R&D work with new technology;
• Maintain high-quality coding standards within the team;
• Create ETL pipelines and data management solutions (API, Integration logic);
• Elaborate different data processing algorithms;
• Involvement in creation of forecasting, recommendation, and classification models;
• Develop and implement workflows for receiving and transforming new data sources to be used in the company;
• Develop existing Data Engineering infrastructure to make it scalable and prepare it for anticipated projected future volumes;
• Identify, design and implement process improvements (i.e. automation of manual processes, infrastructure redesign, etc.).

We offer:

• Great networking opportunities with international clients, challenging tasks;
• Building interesting projects from scratch using new technologies;
• Personal and professional development opportunities;
• Competitive salary fixed in USD;
• Paid vacation and sick leaves, medical insurance;
• Flexible work schedule;
• Friendly working environment with minimal hierarchy;
• Team building activities, corporate events.