Airflow Expert (вакансія неактивна)

About Pwrteams:

Join our fast-growing and diverse team at Pwrteams, where we provide premium IT and engineering nearshore solutions to our global customers. Since 2007, we pursue to become the market leader in assembling cross-border IT and engineering teams for customers. Our operations are strategically positioned within Eastern Europe’s dynamic tech ecosystems, from where we cater the global business landscape. 
We’re at the forefront of travel, media and fintech innovation, healthcare efficiency enhancements, and others. Our goal? To connect interesting customer projects and skilled talent alike. Become a part of our team and take the next step on your personal career journey.

About our client

Our client is a global mining company with a world-class portfolio of products that are used by a billion consumers every day. Our client relies on data and cutting-edge data science to enhance their operations. They also use advanced machine learning and artificial intelligence to optimize their processes.

About the project

Our client is a giant corporation with 90000 employees globally. They have their own innovative IT department handling the whole cycle of development of the products used by the organization. You will work in an international expert team to develop sophisticated software solutions that have a direct impact on almost every aspect of modern life. You will use the innovative practices and the latest technologies to deliver safe and sustainable products to their customers around the world. Data Analytics is a new discipline in the Technical and Sustainability function of our client. The company is going to generate more data than ever before, and it needs to build the systems to support this and for making better decisions.

Responsibilities

• Optimize and fine-tune Apache Airflow environment for performance, reliability, and scalability
• Design and implement modular, reusable DAGs to orchestrate complex data workflows
• Integrate Airflow with Azure Data Factory, Databricks, Synapse, and other Azure services
• Develop and maintain CI/CD pipelines for DAG deployment via Azure DevOps
• Establish robust monitoring, alerting, and logging for Airflow operations
• Provide architectural guidance and hands-on support for new data pipeline initiatives
• Mentor team members and document operational standards and best practices

Qualifications

• Proven expertise with Apache Airflow in production, including scheduler, executors (Celery, Kubernetes), and plugins
• Strong experience with Azure services: Data Factory, Databricks, Storage, Synapse
• Skilled in Python programming with focus on modular, testable code
• Proficient in Azure DevOps (YAML pipelines, release management)
• Knowledge of KEDA and Celery for orchestration and autoscaling
• Experience with Docker, Kubernetes, and Airflow deployment strategies
• Familiarity with monitoring/logging tools: Prometheus, Grafana, ELK, Azure Monitor
• Strong problem-solving, communication, and collaboration skills

Pwrteams offers:

• 24 working days of paid vacation
• 11 paid national holidays
• Health care: up to 10 paid sick days, on-demand medical insurance, vaccinations
• Mental health support: webinars, resources, and compensation for therapy sessions
• Access to our corporate learning platform
• Language classes (English)
• Flexible benefits budget: a fixed monthly amount you can spend on what matters most to you—medical insurance, sports, leisure, fuel, and more
• 8-hour workday aligned with the client’s working hours
• Hybrid work options: work from home with the option to use our cozy office space whenever needed
• Engaging team events and thoughtful gifts throughout the year

In your resume please allow our company to use your personal data.