For over 10 years we have been delivering exceptional results in development of enterprise-scale software systems for a range of clients. Our list of clients grows continuously. We provide software architecture, development services, and most importantly, strive to build long-lasting relationships that help both parties to achieve positive business results now and in the future.
11 липня 2022

Data Engineer (вакансія неактивна)

за кордоном, віддалено

About Project:

Virtuace on behalf of our client — American insurance company is looking for a Data Engineer to join our team.
Client is a global specialty provider of property and casualty insurance and reinsurance that has more than $110 billion USD in total assets along with $17 billion USD in net assets.

Responsibilities:

• Integrating and transforming database applications and web service application; programing interfaces (APIs) through innovative strategies to support operations and decision making;
• Construct and maintain high performing data pipelines, streaming and batch, for internal and external datasets;
• Work with domain experts to translate data requirements to processing specifications;
• Implement procedures to improve system efficiency, security, and compliance;
• Develop and maintain documentation relating to all assigned systems and projects.

Required skills:

• Experience working with disparate input files like Json, XML, CSV, Parquet, Delta;
• Hands on experience in the Azure data stack — Azure ADLS Gen2, Azure Databricks (1+ years), Azure Dev Ops (1+ years);
• Working knowledge (+1 year) of with Pyspark & SQL developing data pipelines in Azure Databricks;
• Self-motivated with superior analytical and problem-solving skills, and a strong sense of accountability;
• Team player who believes in open and continuous communication;
• Intermediate+ level of English.

Will be a plus:

• Working knowledge of Scala is a plus;
• Databrick Application tuning is a plus;
• Experience in the Insurance industry is a plus.