SoftServe is the largest Ukrainian IT company, a team of 8000+ thinkers and makers, true professionals and good people. We like what we do and do it well. For us, that means a lot.
13 февраля 2020

Big Data Engineer (Relocation to Wroclaw), ID 50580 (вакансия неактивна)

Киев, Харьков, Львов, Днепр, Ивано-Франковск, Ровно, Черновцы, за рубежом

SoftServe is a digital authority that advises and provides services at the cutting-edge level of technology. We empower enterprises and software companies to (re)identify their differentiation, accelerate solution development, and vigorously compete in today’s digital economy.
We are currently looking for a Big Data Engineer on a long term basis in Wroclaw. Visa sponsorship is available.

Demonstrating such competencies as
• Experience in financial domain
• Understanding financial terms (ideally background in finance/regulatory reporting)
• Deep understanding of big data technologies
• Experience in Cloud technologies (Azure and/or GCP)
• Hands-on SQL Skills and different DB engines
• Knowledge about Data Lake concepts, data partitioning, and security
• Hands-on Programming/Scripting Experience (Java, Python, Scala, Bash)
• Knowledge about designing Data Pipelines
• Understanding of Data Lineage strategies
• Knowledge about Master Data Management
• Experience in Data Quality methods
• Upper-Intermediate English level

• Java, Python, Scala, Bash
• Cloud technologies (Azure, and/or GCP)
• SQL and different DB engines
• Data Lake
• Data partitioning and security
• Designing Data Pipelines, Data Lineage strategies, Master Data Management, Experience in Data Quality methods

For MVP the idea is to build a solution which allows
• Data Ingestion: We have an immediate need to streamline our data lake ingestion process. Our data ingestion solution will aim to streamline the metadata collection process, and vastly improve the quality of the metadata collected and ultimately stored in the enterprise data catalog. The execution and delivery of the solution is needed to meet the ingestion demands that will be expected of the team in 2020 including DaaS/Digital UX, DaaS Billing, QFC, and other regulatory programs
• Data Enrichment: Enrich the Transactions & Position records as they are being streamed through the lake with Enterprise IDs for Client, Account, Product, Security. Build a rules-driven, metadata-based, pluggable enrichment component to enrich Transactions with Enterprise IDs
Success Criteria
• On-time delivery (3 months duration from the start of Engagement) with relevant software artifacts
• Extensibility (New Data Set), Adaptability (Logic Changes), Scalability (Performance MMs Processed/Enriched), AI Learning/Feedback loop

All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability, sexual orientation, gender identity/expression, or protected veteran status. SoftServe is an Equal Opportunity Employer.

Горячие вакансии

Все вакансии