Candidate location — Ukraine only!
The project aims to create a comprehensive and user-friendly online platform that enhances the customer experience, streamlines operations, and provides essential information for both guests and crew. This portal serves as the central hub for all digital interactions related to cruise company, facilitating bookings, information sharing, and customer support. We are looking for a savvy DevOps Engineer to join our growing team of analytics experts. You will play a crucial role in managing and optimizing our data processing systems. You will be responsible for designing, implementing, and maintaining robust Hadoop cluster and architectures that support our business objectives.
Main tasks and responsibilities:
- Client expectation is of a person having excellent skills in Hadoop Admin core area, who can help on following:
- Solutions for performance tuning on Hadoop clusters (more than just adding resources)
- Cluster management
- Knowledge of how to build a HA architecture
Education, skills and experience:
Must have:
- Big Data Administration: 5-7 years of experience in managing on-premises Hadoop clusters (preferably open source).
- Cloud Platform Management: Proficient in administering cloud environments, with a preference for Google Cloud Platform (GCP) particularly DataProc, GCS and BigQuery..
- Cluster Performance Monitoring: Skilled in screening job performance, capacity planning, and monitoring the health, connectivity, and security of Hadoop clusters using various tools, services and CLI.
- High Availability and Troubleshooting: Experience in setting up high availability (HA), troubleshooting, backup and recovery processes, and reviewing log files and file systems.
- Kafka Administration: Knowledgeable in managing Kafka clusters, along with CDC tools (preferably Debezium).
- DevOps Proficiency: Familiar with DevOps practices, including maintaining Kubernetes clusters, deployment using Jenkins, and infrastructure as code (IaaS) tools such as Ansible and Terraform.
- Linux Administration: Strong background in Linux administration and scripting.
- Testing Environment Setup: Experience in building environments for unit, integration, system, and acceptance testing.
- Primary skills — Kafka, CDC tool and Hadoop (Open Source)
- Secondary skillsd — Kubernetes, Jenkins, Ansible
- Sufficient English level for communication with the client (verbal & written)
Would be a plus:
- Team Management and Collaboration: Proven ability to manage teams and collaborate using tools like Slack, Jira and Confluence.
- Technical Communication: Capable of articulating technical solutions and defining the scope of automation.
- Motivated and Engaging: Enthusiastic about driving requirements and design discussions.
- Interpersonal Skills: Exceptional collaboration and communication skills in a team setting.
- Analytical Mindset: Possesses a structured, conceptual approach paired with strong quantitative and analytical problem-solving abilities.