Data Engineer

We’re looking for a Data Engineer to join our Amsterdam-based technology client working on their AI-powered decision-support platform.

Our client is an Amsterdam-based technology organization operating in the Fintech and Regtech sectors. Their flagship product, is an AI-powered decision-support platform addressing Know Your Customer (KYC), Customer Due Diligence (CDD), and Anti-Money Laundering (AML) compliance. Their product enables client onboarding and screens clients against various databases.

We are seeking a skilled Data Engineer to join our client’s team for at least a six-month period. The role entails support in data engineering, specifically in Python programming, to ensure continuity in their data scraping operations.

The ideal candidate will be experienced in data engineering practices, particularly in Python development, and will contribute to the client’s projects focused on data scraping, transformation, and integration. This role requires close collaboration with client’s in-house team via Scrum, and thus, strong communication skills are essential.

What you’ll do in this role

• Debugging and fixing broken spiders.
• Developing new spiders of interest.
• Ensuring smooth handover and continued operation of the data scraping engine.
• Adhering to their Scrum-based development methodology with daily standups.
• Developing and maintaining their data scraping engine in alignment with current best practices.
• Developing on their internal scraping platform, internal sanctions data retrieval, their proprietary data platform, such as integrating third-party data vendors into it.
• Work on the project for at least a 6-month period.

We’re looking for

• Middle-level Python programming, adhering to in-company standards.
• Experience with ETL pipelines and custom data transformations.
• Experience with scraping sources, preferably through Scrapyd.
• Experience with containerization, preferably through Docker.
• Experience with Elasticsearch.
• Experience with version control systems such as GitHub or GitLab.
• Basic understanding of CLI usage in Unix systems.
• Proficient in English writing and speaking.

How to knock our socks off

• Experience with Postgres or other SQL languages.
• Naming five or more dishes that include beetroot besides borshch.

✔ Not checking every box?

This job looks very exciting, but you hesitate to apply because of the confidence gap? Reach out to us anyway! Beetroot is an inclusive workplace that considers all applicants. Equality is one of our core values. We’re committed to providing equal opportunity and a sense of belonging for all Beetroot consultants and candidates. So let’s discover together whether we could be an excellent fit for each other.