Imagine branching out and trying out your skills in the international arena, learning from committed professionals from the US, Brazil, Poland, and Ukraine. And at the same time having your like-minded teammates and feeling part of things. Tempting?
24 листопада 2023

Senior Data Engineer (вакансія неактивна)

São Paulo (Brazil), Івано-Франківськ, Вроцлав (Польща), віддалено

Softjourn is looking for a Senior Data Engineer!

About the project:

The system for interest assessment to find educational and career pathways for users. For each pathway, the system links user interests to careers, salaries, job outlooks, skills, and the education they will need to meet their goals. The project is about an extensive system with many integrations (SparkPost, Twilio) and separate subprojects (40+).

Involvement:

To be discussed

Project technologies:

EDW: Pentaho, PostgreSQL, AWS API Gateway, Lamba Function (written in Python)

Back-end: Node.js, PostgreSQL, Redis, sails.js

Front-end: angular.js, angular

Tools: npm, grunt, webpack

Requirements:

  • We are looking for a Senior Data Engineer with at least 5 years of experience in designing, building, optimizing and maintaining data pipelines and databases;
  • You should have a deep understanding of database structure and data warehouse concepts, as well as strong skills in SQL development and data transformation;
  • You should also have solid experience with Pentaho, a leading data integration and analytics platform, and AWS, especially Lambda functions and API gateway;
  • Additionally, you should be able to optimize the performance and scalability of the enterprise data warehouse.

Nice to have:

  • Familiar with Superset, Sqitch, Bamboo;
  • Experience with Python.

Responsibilities:

  • As a Data Engineer, you will be responsible for analyzing the current state of the EDW and proposing solutions to improve its efficiency and performance;
  • You will also maintain and develop order fulfillment integrations for the existing EDW using Pentaho, a leading data integration and analytics platform;
  • Furthermore, you will design and implement logical and physical data models that meet the business requirements and follow the best practices;
  • Additionally, you will write and update technical documentation that describes the standard processes and guidelines for other developers.