Senior/Lead Data Engineer

Job description

We’re looking for a senior data engineer to join our core team and work on a highly complex cybersecurity project.

Our client is a well-funded startup ($7.5M raised in seed) building the first application detection & response platform. Using OpenTelemetry and trace analytics, their solution enables enterprises to stop attacks with in-application context into all runtime transactions and behaviors. The company’s mission is to revolutionize application security with real-time anomaly detection and monitoring, automated incident response and rich context.

In this role, you’ll be tasked with designing and developing scalable data pipelines capable of ingesting, processing and cross-referencing large volumes of data efficiently. Our ideal candidate will have experience with distributed systems, data architecture, and performance optimization to ensure the seamless flow and integrity of data within the platform.

Required skill-set & experience

• Proven track record as a data engineer (4+ years of hands-on commercial experience), fluent in industry trends & best practices
• Proficiency in building data pipelines with Python. Scala or Java experience is also OK, but Python preferred
• Hands on experience with:
  
  • data orchestration and ETL tools
  • relational database management systems
  • cloud or columnar data stores such as Clickhouse, Redshift, Snowflake, or Hive/Presto
  • NoSQL datastores (OpenSearch, Cassandra)
  • stream processing tools (Kafka, Kafka Streams, Apache Flink)
• Good grasp of distributed systems, core CS algorithms, data structures and their tradeoffs
• Upper-intermediate+ level of English

Bonus points

• Experience with OpenTelemetry and tracing
• “Designing Data-Intensive Applications” is a book you read and love
• DevOps experience, ability to handle basic data-related infrastructure independently when needed
• Experience in the cybersecurity domain
• You’re a contributor to open-source software, or run your own projects

What’s in it for you

• Opportunity to become a core part of a boutique software consultancy, working with well-known international customers and highly complex tech challenges
• Competitive salary
• Paid vacation and sick leave
• Remote-friendly culture
• Internal mentorship and upskilling
• Learning & development budget ($400/year)
• PE administration support
• Yearly company ski trips (after Ukraine’s victory 🇺🇦⛷️)