DevOps Engineer - Distributed Systems (вакансія неактивна)

The company’s mission is a world of search transparency where precise ads connect marketers to consumers. This statement is key to their ethos here and is backed by their Whole Market View technology, a dynamic, AI-driven, data model that is unique for each advertiser, representing their entire relevant search landscape. Powered by their patented machine learning technology, Whole Market View provides the comprehensive data scope and quality required by the world’s leading advertisers to precisely assess competitive opportunities at scale across their entire market, without limitations. Their index information hourly, processing over 10TB of new data, 500 million adverts, and 200 million keywords across 15 different languages each day. The segmented data is presented in an intuitive format, helping digital marketers to understand their landscape and acquire more customers. The technology has also won a number of awards for its ease of use and value-added to clients including Best Search Software Tool at the UK Search Awards 2016, Technical Innovation of the Year at the Drum Search Awards 2017, Best Search Technology of the Year at the Biddable Media Awards 2017 and Best Tech Platform at the DADI awards 2017. The company was founded by Ian O’Rourke and is backed by Mel Morris, the entrepreneur behind Candy Crush and former chairman of King.com.

Things that make this Company Unique

Machine-Learned Whole Market View
AI-Driven Data Segmentation
Automated trend detection & monitoring technology
Built for Client Value and Outcomes
World Class Customer Success

The company Technology team is one of the best in the business and is the fuel. From patented machine learning methods to developing an award-winning application, their Technology team is continuously innovating and enabling technology to solve real problems for their customers. They are looking for a proficient DevOps Engineer who is excited about working with some of the most talented engineers and data scientists in the industry to build amazing technologies and develop their careers to be the best at what they do.

Qualifications:

• Bachelor degree in Computer Science, similar technical field of study, or equivalent practical experience
• Proven successful experience as a DevOps engineer
• Excellent communication skills
• Exceptional analytical, quantitative, problem-solving, critical thinking,
• Confident writing production-quality code (bash etc)
• Building and automating deployment pipelines using CI/CD tools.

As a plus:

• Experience working on complex distributed systems and version control systems
• Good knowledge of the core technologies they use
• Experience with Ansible, Terraform, or other configuration management systems
• Experience with Docker
• Confident writing production-quality code preferably in Python and SQ

Responsibilities

• Automate the provisioning, management, and monitoring data platforms and architecture
• Manage the deployment, orchestration, and monitoring of data processing and dissemination platform
• Design and implementation of CI/CD pipelines covering infrastructure, code build, and deployment
• Develop internal tooling and capability to support their engineers and SaaS solutions
• Work closely with teams to create ultra-scalable, flexible, and highly reliable systems
• Troubleshooting, diagnosing, and fixing production software issues
• Working with AWS technologies and improving infrastructure security and resiliency
• Take ownership and pride in the products they build and always make sure they are of highest standard
• Creating / scripting, monitoring, and maintaining Spark Clusters
• Building and working with complex ETL workflows (Luigi, Airflow)
• Be empathetic towards team members and customers

Technologies they Use across their Technology Teams

• Languages: Java, Scala, JavaScript, Python, SQL, Bash
• Frameworks: Spark (scala), DropWizard, React, Backbone, Akka, Play Framework (Scala), Flask
• Databases: PostgreSQL, AWS(S3), Redshift, Redis, MongoDB, Cassandra
• Technologies: RabbitMQ (messaging), Quartz scheduling, Maven
• CI/CD: TeamCity, Jenkins
• Containerisation: Docker, Kubernetes
• Configuration: Ansible, Terraform
• Monitoring: ELK, Grafana, Prometheus
• Source Control: Git (GitHub)
• Cloud: AWS
• Other Tools: IntelliJ IDEA, Jira, Kibana

About the Data Team

The company data team is a market leader in developing complex ETL and machine learning solutions. With published authors and award winning data scientists who contribute some of the major machine learning and distributed data technologies such as Apache Spark, they are a friendly, passionate group of engineers making a career out of building great software for their customers.
The company`s architecture is dealing with billions of data points every day, generated from over two thousand data processes running through orchestrated workflows, multiple machine learning models, distributed computations in spark, web applications, and streaming data coming in twenty-four hours a day at hundreds of times a second.
Their engineering culture is underpinned by sharing knowledge, coaching and growing together. You will have the opportunity to innovate with new technologies and make their system your own by having the freedom and responsibility that they think all engineers deserve. You will enjoy this role if you love technology, love being involved in every part of a complex architecture, working with the latest technologies, and solving problems at a large scale.
As a DataOps Engineer, you will be working across their entire stack, so a real passion to drive the product and technology forward is something that they value. Your responsibilities will include creating a vision for the future architecture of this complex data system, adding innovative ideas that use the latest cutting edge technology. You will work closely with Data, Data Science and Web teams to deliver the best quality architecture and automation solutions for their teams.