Middle Big Data Engineer (ID 59122) (вакансія неактивна)

WE ARE
Our client is the UK’s leading consumer credit finance company, with over 5.8 million customers. Provides products and services for customers in two unsecured credit market sectors: Near Prime business and our Co-brand business.
Our proprietary risk management models and segmented approach to both sectors enable us to target the specific needs of customers with tailored products. This approach, coupled with our continued commitment to responsible lending and outstanding customer service, has allowed us to deliver a strong balance sheet and high cash flow generation, providing a foundation for growth and attractive shareholder returns.

YOU ARE
• Proficient in Big Data data integration technologies such as Spark, Scala, Kafka
• An excellent Scala/Java engineer with knowledge of and experience with container frameworks
• Showing profound API and library design skills
• Proficient with traditional database SQL technologies (Oracle, SQL Server, DB2)
• Experienced with integration of data from multiple data sources
• Professional in writing high-performance, reliable and maintainable code
• Pretty knowledgeable about NoSQL database structures, theories, principles, and practices
• Demonstrating analytical and problem-solving skills applied to the Big Data domain Experience of CI/CD best practice
• Showing a good aptitude in multi-threading and concurrency concepts
• Experient with cloud deployment

YOU WANT TO WORK WITH
• Modeling, manipulation, transformation, and loading of the Data Lake technology layers
• Prototyping new data sources internally and external
• Designing and code data transformation and load processes through the various layers of the Data Lake using Big Data open technologies such as Kafka, Spark, Scala, and associated AWS tooling
• Delivering a high volume, performant environment, structured to enable the Data Science roles to run modeling and insight activity and the core Data Warehouse users to build insight
• Ensuring that a strong data map is in place for the Data Lake, keeping abreast of all data sources and future sources of information
• Proactive communication with customers

TOGETHER WE WILL
• Building a knowledge of all existing data manipulation within both data warehouse systems and within the business marts
• Work with the business units to become a subject matter expert on the data
• Organize faciliation of the work of the data scientists and data warehouse users and reduce their workload in data preparation
• Have active communication with our client
• Help customer to automate various business processes