About Project:
Virtuace on behalf of our client — American insurance company is looking for a Data Engineer to join our team.
Client is a global specialty provider of property and casualty insurance and reinsurance that has more than $110 billion USD in total assets along with $17 billion USD in net assets.
Responsibilities:
• Integrating and transforming database applications and web service application; programing interfaces (APIs) through innovative strategies to support operations and decision making;
• Construct and maintain high performing data pipelines, streaming and batch, for internal and external datasets;
• Work with domain experts to translate data requirements to processing specifications;
• Implement procedures to improve system efficiency, security, and compliance;
• Develop and maintain documentation relating to all assigned systems and projects.
Required skills:
• Experience working with disparate input files like Json, XML, CSV, Parquet, Delta;
• Hands on experience in the Azure data stack — Azure ADLS Gen2, Azure Databricks (1+ years), Azure Dev Ops (1+ years);
• Working knowledge (+1 year) of with Pyspark & SQL developing data pipelines in Azure Databricks;
• Self-motivated with superior analytical and problem-solving skills, and a strong sense of accountability;
• Team player who believes in open and continuous communication;
• Intermediate+ level of English.
Will be a plus:
• Working knowledge of Scala is a plus;
• Databrick Application tuning is a plus;
• Experience in the Insurance industry is a plus.