Dive deep into Digital! For 20 years Intellias has been developing top-tier digital solutions for the world’s leading companies, keeping them in line with the latest technology trends. Join in and provide innovations for the future!
What project we have for you
Project focus: to move from BigQuery to Databricks and set up Databricks.
What you will do
- Collaborate with business stakeholders and technical teams to understand and analyze data requirements.
- Design, build, test, and maintain scalable data systems using Azure Databricks.
- Develop data processing pipelines with Databricks Notebooks, Python (and Python libraries), and other tools.
- Ensure efficient ETL processes and optimal data performance.
- Monitor and improve data reliability, efficiency, and quality.
- Maintain documentation on data pipeline architecture and governance.
- Provide technical support for data-related issues to both internal data engineers and BI developers.
- Ensure data integrity, consistency, and accuracy through robust data quality assurance measures .
- Review and support team members, providing guidance and mentorship.
- Supervise and contribute to the data-driven strategy for the project, aligning it with business objectives .
What you need for this
Required skills:
- 5+ years of hands-on experience in data engineering with Python and SQL.
- 3+ years of experience with cloud vendors Azure, DWH services (Databricks, BigQuery), cloud storages (Azure Storage), etc.
- Strong experience with ETL/ELT/orchestration tools (e.g., Airflow, ADF).
- Drive the design and implementation of data warehouse and data lakes.
- Knowledge of DevOps practices and CI/CD pipelines.
- Experience with requirement gathering and documentation.
Will be a plus:
- Experience with NoSQL.
- Bachelor’s or Master’s in Computer Science, Engineering, or a related field.
- Relevant Azure and Databricks certifications (e.g., Data Engineer Associate).
- Familiarity with machine learning frameworks and data visualization techniques.
What it’s like to work at Intellias
At Intellias, we are committed to being an equal opportunity employer, fostering equity, diversity, and inclusion. We welcome and celebrate the differences of all qualified applicants. Join Intellias for a career where your unique perspectives are not only valued but crucial to our success.