Senior Data Engineer (вакансія неактивна)

We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will be deeply involved in discovering, analyzing, and assembling large and complex data sets. They will design and build our big data infrastructure, ensure data security, and optimize the performance of our big data platforms, primarily within the AWS cloud environment.

Requirements:

• At least 4 years experience in building, optimizing, and maintaining big data pipelines and architectures;
• Strong proficiency in Python;
• Hands-on experience with ETL pipeline construction in an AWS environment;
• Familiarity with AWS services such as AWS Lambda, Amazon EventBridge, Amazon S3, Amazon Kinesis, and AWS Step Functions;
• Experience with ELK stack or OpenSearch platforms;
• Solid understanding of data security and implementing access controls in the AWS cloud platform;
• A clear grasp of Data Warehouse architecture concepts;
• Exceptional problem-solving, analytical skills, and a knack for troubleshooting complex data challenges;
• Strong interpersonal skills with a demonstrated ability to communicate data findings clearly to both technical and non-technical audiences;
• Team player with the ability to collaborate effectively in a diverse environment;
• AWS certification(s) in relevant services is a plus;
• Intermediate or higher level of English.

Responsibilities:

• Discover, analyse, and assemble large, complex data sets to meet functional and non-functional business requirements;
• Design, build, optimize, and maintain robust ’big data’ data pipelines, architectures, and datasets;
• Build scalable ETL pipelines for various data sources using Python in the AWS ecosystem;
• Engage with AWS services including AWS Lambda, Amazon EventBridge, Amazon S3, Amazon Kinesis, and AWS Step Functions;
• Implement and manage ELK stack or OpenSearch-based platforms;
• Ensure robust data security measures and access controls are implemented across our AWS data infrastructure;
• Collaborate with team members to improve existing systems, streamline processes, and drive data-related initiatives;
• Understand and leverage the architecture of data warehouses for optimal performance;
• Troubleshoot and resolve data issues, ensuring data accuracy and reliability;
• Collaborate effectively with cross-functional teams, presenting data findings and insights when required.

Why CHI Software?

• AI Excellence Award in 2022;
• Confirmed status of a Microsoft Partner;
• Confirmed ISO 27001 and ISO 9001 certifications;
• Four new offices in 2022 in Kobe (Japan), Florida (USA), Barcelona (Spain), and Krakow (Poland);
• Participation in significant tech conferences in Tokyo, Kobe (Japan), and London (UK) with the booth and visited more than 15 conferences in 6 countries;
• The New York Times, BBC, Hackernoon, and other popular media platforms wrote about us.

Our perks

• Covered vacation period: 20 business days and 5 days off;
• Free English classes;
• Flexible working schedule;
• Truly friendly and supporting atmosphere;
• Working remotely or in one of our offices;
• Medical insurance for employees from Ukraine;
• Compensation of psychological counseling;
• Legal support;
• Relocation assistance.