Intellias is a company created by people, for people. We foster a culture of partnership, caring, and respect. We will never back down on that no matter how fast we grow. What's important to us is attention to individuals, not do-it-like-this processes. Whether we succeed or fail, learn or mentor, start new journeys or reach new heights, we make sure to keep our human touch.
30 жовтня 2024

Senior Data Engineer (вакансія неактивна)

віддалено

Dive deep into Digital! For 20 years Intellias has been developing top-tier digital solutions for the world’s leading companies, keeping them in line with the latest technology trends. Join in and provide innovations for the future!

What project we have for you

Project focus: to move from BigQuery to Databricks and set up Databricks.

What you will do

  • Collaborate with business stakeholders and technical teams to understand and analyze data requirements.
  • Design, build, test, and maintain scalable data systems using Azure Databricks.
  • Develop data processing pipelines with Databricks Notebooks, Python (and Python libraries), and other tools.
  • Ensure efficient ETL processes and optimal data performance.
  • Monitor and improve data reliability, efficiency, and quality.
  • Maintain documentation on data pipeline architecture and governance.
  • Provide technical support for data-related issues to both internal data engineers and BI developers.
  • Ensure data integrity, consistency, and accuracy through robust data quality assurance measures .
  • Review and support team members, providing guidance and mentorship.
  • Supervise and contribute to the data-driven strategy for the project, aligning it with business objectives .

What you need for this

Required skills:

  • 5+ years of hands-on experience in data engineering with Python and SQL.
  • 3+ years of experience with cloud vendors Azure, DWH services (Databricks, BigQuery), cloud storages (Azure Storage), etc.
  • Strong experience with ETL/ELT/orchestration tools (e.g., Airflow, ADF).
  • Drive the design and implementation of data warehouse and data lakes.
  • Knowledge of DevOps practices and CI/CD pipelines.
  • Experience with requirement gathering and documentation.

Will be a plus:

  • Experience with NoSQL.
  • Bachelor’s or Master’s in Computer Science, Engineering, or a related field.
  • Relevant Azure and Databricks certifications (e.g., Data Engineer Associate).
  • Familiarity with machine learning frameworks and data visualization techniques.

What it’s like to work at Intellias

At Intellias, we are committed to being an equal opportunity employer, fostering equity, diversity, and inclusion. We welcome and celebrate the differences of all qualified applicants. Join Intellias for a career where your unique perspectives are not only valued but crucial to our success.