We are seeking a highly skilled and motivated Data Engineer with expertise in creating and managing data lakes and data warehouses. In this role, you will be responsible for designing and implementing efficient data storage and processing solutions using a variety of Cloud tools. You will collaborate closely with Data Scientists and other stakeholders to understand their data requirements and build scalable solutions to support their analytical needs. The ideal candidate has experience in MySQL, AWS, Redshift, Snowflake, Airflow or the like. They will be self-motivated and driven, and able to collaborate with teammates to understand business requirements and translate them into technical solutions.
Requirements:
- 3+ years of experience in Data Engineering.
- Excellent command of written and spoken English (Upper Intermediate)
- Experience with SQL server, VB.Net, ASP.NET core, IIS
- Experience in AWS infrastructure and micro services
- Tools and software include: SSMS, MS SQL Server, MS Access, AWS, Git, GitHub, .Net Core, ASP, MySQL
- Bachelor’s degree in Computer Science, Computer Information Systems or equivalent degree.
- Proven experience designing and implementing data lakes and data warehouses.
- Hands on experienced in data modeling in all phases (conceptual, logical, and physical).
- Experience with data integration, ETL processes, and data modeling concepts.
- Familiarity with cloud platforms and their data-related services.
- Knowledge of data governance, data security, and regulatory compliance practices.
- Strong analytical and problem-solving skills, with the ability to analyze complex datasets and derive meaningful insights.
Responsibilities:
- You will work with the Engineering team to support, maintain and build the modernization effort of the existing portfolio of applications.
- Ability to build and optimize data sets, data files, data pipelines and architectures.
- Ability to perform root cause analysis on external and internal processes and gaps in data to identify opportunities for improvement and work with stakeholders to resolve issues.
- Ability to quickly understand the business and provide robust solutions and resolve current production issues.
- Ability to continue to support legacy current applications.
- Create and maintain optimal data pipeline architecture,
- Assemble and process, large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, and work with IT in re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
- Create data pipeline for analytics and data scientist team members that assist them in building and optimizing our product/Data dashboards.
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Mentor junior engineers and provide onboarding to new hires
- Establish best-practice methodologies for new development and ongoing support
- Ability to work with and coordinate with other developers using tools such as Slack, Git Hub, Jira, Confluence, YouTrack
Working conditions:
Compensation for sick leaves (8 days), vacation (20 days per year)
Compensation for specialized courses, training, etc. (from 30% to 100%) — on hold
Compensation for specialized software (from 30% to 100%) — on hold
Bonus for sports activities (up to 50% paid by the company) — on hold
English lessons
Massage at the office
Lawyer Services
Car and bike parking lots
Helping with registration and management of the PE
IT Club Loyalty Program Membership
Team buildings, pizza, and beer parties, corporate events every month
Coffee, milk, and cookies at the office