Backend Engineer, Data Management (вакансія неактивна)

Develop new data engineering/data catalog tools and maintain existing code. This position is primarily about implementing efficient tools and workflows for data cataloging and data manipulation. Having prior experience with data discovery tooling is a big plus.

Along the way, you will develop comprehensive automated testing to ensure the product is reliable and scalable. You will handle issues and fix bugs promptly to minimize disruption to users as we roll out these state of the art pipelines while also maintaining backwards compatibility. Pairing with and mentoring colleagues is a must. We are a very collaborative team.

You should be interested in, and capable of building and maintaining complex systems. You should be highly-motivated, capable of working independently, and proficient in the following areas:

Requirements

• 3+ years of professional software development experience
• Knowledgeable about data cataloging and transformation tools
• Python programming (python 2 and 3)
• MongoDB / NoSQL Databases
• SQL / Traditional Databases
• Ability to plan and lead projects from start to finish and explain your design decisions
• Familiarity with collaborative development, including code reviews. Either in a commercial or open source environment.
• Strong desire to build efficient and useful tools

Experience in the following areas would be a plus, but not necessary:

• Data manipulation using Python tools
• Java / Scala / C++
• Data manipulation using Spark or other distributed processing technologies
• Familiar with the Kubernetes ecosystem
• Linux shell scripting, Linux operating system
• Jenkins or other Continuous Integration platform
• AWS technology
• Worked in a start-up environment