Data Engineer (Scala/Spark) (вакансія неактивна)

Adthena’s data team is a market leader in developing complex ETL and machine learning solutions. With published authors and award winning data scientists who contribute some of the major machine learning and distributed data technologies such as Apache Spark, we are a friendly, passionate group of engineers making a career out of building great software for our customers.

As a Data Engineer, you will be working across our entire stack, so a real passion to drive the product and technology forward is something that we value. Your responsibilities will include helping with a vision for the future architecture of this complex data system, adding innovative ideas that use the latest cutting edge technology. You will work closely with Web and Data Science teams to deliver user-centric solutions to our customers and become an expert in developing high quality technical solutions

Preferred qualifications:

• Bachelor degree in Computer Science, similar technical field of study or equivalent practical experience;
• Commercial experience developing Spark Jobs using Scala;
• Commercial experience using Java and Scala (Python nice to have);
• Experience in data processing using traditional and distributed systems (Hadoop, Spark, AWS — S3);
• Experience designing data models and data warehouses;
• Experience in SQL, NoSQL database management systems (PostgreSQL and Cassandra).

Desirable

• Commercial experience using messaging technologies (RabbitMQ, Kafka);
• Experience using orchestration software (Chef, Puppet, Ansible, Salt);
• Confident with building complex ETL workflows (Luigi, Airflow);
• Good knowledge working cloud technologies (AWS);

Technologies We Use:

• Languages: Java, Scala, JavaScript (React, Backbone), SQL and scripting using Bash and Python;
• Frameworks: DropWizard, React, Akka and Play Framework (Scala);
• Databases: PostgreSQL, AWS(S3), Redshift, Redis, MongoDB, Cassandra;
• Technologies: RabbitMQ (messaging), Quartz scheduling, Docker and Kubernetes, Maven.

Responsibilities:

• Build services/features/libraries that serve as a definitive examples for new engineers and makes major contributions to library code or core services;
• Design low risk Spark process and write effective complex Spark jobs (data processes, aggregations, pipeline);
• Design low risk APIs and write complex asynchronous, highly parallel low latency APIs and processes;
• Write high quality, extensible and testable code by applying good engineering practices (TDD, SOLID) using Adthena’s Engineering Practices;
• Understand and apply modern technologies, data structures and design patterns to solve real problems efficiently;
• Support TA and Data Science team to help deliver and productionise their backlog/prototypes

Benefits and Perks:

• Startup Engineering culture;
• Good work/life integration (flexible working);
• Untracked annual leave;
• Individual coaching programme;
• Monthly Socials and company-wide retreats
• Free Trainers when you join our team;
• Social activities to join in.