DataForest — helps companies use data to drive decisions. We apply Data Science techniques combined with expertise in business automation, large-scale data analysis, and advanced software engineering to improve performance outcomes for organizations and create added value for their clients and shareholders.
9 липня 2024

Data Engineer Tech Lead/Team Lead

Київ, віддалено

Looking for a Lead Data Engineer to join the Dataforest team. If you are looking for a friendly team, a healthy working environment, and a flexible schedule ‒ you have found the right place to send your CV.

As a Team Lead, you will be an expert and a leader, playing a crucial role in guiding the development team, making technical decisions, and ensuring the successful delivery of high-quality software products.

Skills requirements:

  • Previous experience in a Team Lead role;
  • 5+ years of experience with Python;
  • 4+ years of experience as a Data Engineer;
  • Knowledge of data algorithms and data structures is a MUST;
  • Excellent experience with Pandas;
  • Excellent experience with SQL DB / NoSQL (Redis, Mongo, Elasticsearch) / BigQuery;
  • Experience Apache Kafka, Apache Spark (pyspark);
  • Experience with Hadoop;
  • Familiarity with Amazon Web Services;
  • Understanding of cluster computing fundamentals;
  • Working with high volume tables 100m+.

Optional skills (as a plus):

  • Experience with scheduling and monitoring (Databricks, Prometheus, Grafana);
  • Experience with Airflow
  • Experience with Snowflake, Terraform;
  • Experience in statistics;
  • Knowledge of DS and Machine learning algorithms.

Key responsibilities:

  • Manage the development process and support team members;
  • Conduct R&D work with new technology;
  • Maintain high-quality coding standards within the team;
  • Create ETL pipelines and data management solutions (API, Integration logic);
  • Elaborate different data processing algorithms;
  • Involvement in creation of forecasting, recommendation, and classification models;
  • Develop and implement workflows for receiving and transforming new data sources to be used in the company;
  • Develop existing Data Engineering infrastructure to make it scalable and prepare it for anticipated projected future volumes;
  • Identify, design and implement process improvements (i.e. automation of manual processes, infrastructure redesign, etc.).

We offer:

  • Great networking opportunities with international clients, challenging tasks;
  • Building interesting projects from scratch using new technologies;
  • Personal and professional development opportunities;
  • Competitive salary fixed in USD;
  • Paid vacation and sick leaves, medical insurance;
  • Flexible work schedule;
  • Friendly working environment with minimal hierarchy;
  • Team building activities, corporate events.