Annual Open Tech Conference - ISsoft Insights 2021. June 19. Learn more.
SoftConstruct is the innovator in the field of big data and computer vision among Ukrainian IT companies with HQ in Armenia, Yerevan. We combine our extensive experience in the development of SportTech software with advanced technologies to develop original software for sports statistics, risk analysis and security.
11 марта 2021

Big Data Engineer (Java) (вакансия неактивна)

Киев

ABOUT COMPANY
SoftConstruct Ukraine is one of the innovators in the field of big data and computer vision among Ukrainian IT companies with HQ in Armenia, Yerevan. We combine our extensive experience in the development of SportTech software with advanced technologies to develop original software for sports statistics, risk analysis, and security.

ABOUT PRODUCT
Data Platform that delivers the performance, simplicity, concurrency, and affordability for data collecting, rapid analytics, and extracting data-driven insights for business users.
Lambda architecture, designed to handle massive quantities of data by taking advantage of both batch and stream-processing methods. This approach to architecture attempts to balance latency, throughput, and fault-tolerance by using batch processing to provide comprehensive and accurate views of batch data, while simultaneously using real-time stream processing to provide views of online data.
In many organizations, data consumption processes for timely reporting or crucial analytical requirements are hindered by delays in query execution and information presentation. The main challenge is to minimize decision delay with the help of flexible solutions with open and simplified architecture and high performance based on future-oriented technologies using AI models and forecasting analytics.

In numbers:
Up to 1 PB of data from 500+ partners in long-term storage
30+ M new records daily
Latency for insight based on data delivery time <5 sec
STACK:
Kafka (KSQL, Streams), Kafka Connect, Google Cloud as Cloud Hadoop, Google Dataflow (Apache Beam), BigQuery, SQL, Kubernetes, Java/Python

YOU HAVE
— Knowledge of Java and Java SDK;
— Knowledge of data structures and algorithms;
— Knowledge of OOP/OOD;
— Knowledge of software design concepts, principles, and patterns;
— Good knowledge of one of stream processing tools (Kafka Streams, Spark Streaming, etc);
— Experience with at least one of Cloud Platforms (GCP, AWS, etc);
— Experience in working with relational and non-relational databases;
— Mathematical thinking, analytical and problem-solving skills, self-motivated, organized team player.

NICE TO HAVE
— Some experience with IoC Tools (Terraform, Ansible);
— Understanding Big Data technologies (MapReduce, Hadoop, Spark, Presto, Drill...);
— Knowledge of data warehouse architecture, infrastructure components, ETL;
— Experience with Google Cloud stack (GCS, BigQuery, DataFlow, Pub/Sub).

CHALLENGES
— Development, implementation, and automation of distributed system deployment for collecting and processing events from several sources.
— Data schema development and management of internal data warehouses and database systems (SQL/NoSQL).
— Writing ETL-jobs to calculate business metrics;
— Reviewing project documentation, analyzing requirements;
— Participating in code reviews, teamwork, helping colleagues.

What can we offer you in addition to the invaluable experience and the innovative project?
A team of experts in the field of Data Science & Machine Learning, who are open to sharing knowledge and experience and often act as speakers at technical conferences in Ukraine and abroad.
Support in training and development, starting from free English courses in the office and developing IDP to paying for Ukrainian and foreign conferences and other events.
Well, of course: medical insurance, 24 calendar days of vacation, paid sick leave and more.
And yes, by the way, our office is a 7-minute walk from Lukyanivska metro station.

Горячие вакансии

Все вакансии