Senior Data Engineer (вакансія неактивна)

• 7+ years of experience building data pipelines
• 3+ years of experience building data frameworks for unit testing, data lineage tracking, and automation
• Fluency in Scala and at least one other server-side programming languages (e.g. Python, Java, Go)
• Proficient on Apache Spark
• Familiarity with streaming technologies (e.g., Kafka, Kinesis, Flink)

Overall Project Technologies:
• 1st stack: Ruby with Redux, React on Front End; microservices in Go, Python, .NET Core
• 2nd stack: ASP.NET, SQLServer, PostgreSQL
• AWS as a default hosting platform
• Web, desktop, mobile

• The candidate should be technically strong and ready to provide guidance to other team members, not only the coding
• Set up testing, CI/CD, code conventions
• No emphasis on DevOps side — leaning on hosted solutions
• Streaming + batching (98% batching). In long term perspective — more streaming
• Sometimes a team has performance issues. Possible reason — no much experience with Spark
• Datasets are very diverse; processing is usually complex — so it’s not a routine all day to day, but more like solving new challenge each time
• Considering Apache Flink for stream processing (not implemented right now)
• Joining ’report & analytics development’ team — ETL, data pipelines (though will not work with reports themselves)

We are looking for a Senior Data Engineer to join our Team and work on the payroll, benefits, and talent Management Platform on the Project.

We develop the only payroll, benefits, and talent Management Platform. It’s more than Management System software: it’s the compliance and benefits consulting you need. The Product mission is to empower everyone to make data-driven decisions about people. From HR to the C-Suite to employees, we believe that accessible data has the power to make all of us more strategic and impactful.

Our MS system consists of the following core modules:
• Payroll
• Benefits administration
• Performance management
• Human capital management