Senior Python Engineer (DWH) (вакансія неактивна)

SoftConstruct Ukraine is a large product company with Armenian roots.
We develop solutions in the fields of Big Data, Data Science and CryptoExchange. We combine our expertise in iGaming software development with advanced technologies to develop original software such as sports statistics, risk analysis, security. In most cases, we deal with atypical projects for the market, try to find and generate new technology-based solutions in our field.

We support our colleagues who actively participate in all spheres of our country’s defense, as well as help in the development of solutions, technical security support — the information sector of the state. We are ready to offer work for IT specialists who need it.

If you are looking for a job as a Senior Python Engineer we would be more than happy to offer you our position.

About product:

Data Platform that delivers the performance, simplicity, concurrency and affordability for data collecting, rapid analytics, and extracting data-driven insights for business users.

Lambda architecture, designed to handle massive quantities of data by taking advantage of both batch and stream-processing methods. This approach to architecture attempts to balance latency, throughput, and fault-tolerance by using batch processing to provide comprehensive and accurate views of batch data, while simultaneously using real-time stream processing to provide views of online data.

In many organisations, data consumption processes for timely reporting or crucial analytical requirements are hindered by both delays in query execution and information presentation. Main challenge is to minimize decision delay with the help of flexible solutions with open and simplified architecture and high performance based on future oriented technologies using AI models and forecasting analytics.

In numbers:

• Up to 1 PB of data from 500+ partners in long-term storage
• 30+ M new records daily
• Latency for insight based on data delivery time <5 sec

Technical Stack:

Kafka (KSQL, Streams), Kafka Connect, Google Cloud as Cloud Hadoop, Google Dataflow (Apache Beam), BigQuery, SQL, Kubernetes, Java/Python, Apache Airflow

Must have:

— 5+ years of experience in Python;
— Experience working on relational databases (PostgreSQL, Microsoft SQL Server);
— Experience working on NoSQL databases (Elasticsearch, Redis);
— Knowledge of performance tuning of ETL jobs, SQL’s, Partitioning, Indexing;
— Experience in writing complex SQL queries;
— Experience with Cloud Services (preference to Google Cloud Platform);
— Experience working on Linux, Kubernetes, Docker;
— Experience in incorporating and utilizing BDD / TDD / Unit testing;
— Exceptional problem solving, technical and data analysis skills;
— Extensive knowledge of best practices in software design and design patterns;
— Strong Computer Science fundamentals.

Nice to have:

— Knowledge of Data Warehouse concepts;
— Experience with Data visualization/Business Intelligence tools;
— Experience with designing, implementing RESTful API’s (Aiohttp, FastAPI).
— Some experience in any Big Data technologies (MapReduce, Spark, Presto, Drill...);
— Some experience in any Graph databases (Neo4j, AgensGraph);
— Some experience with IoC Tools (Terraform, Ansible);
— Some experience working with Workflow tools (such as Apache Airflow);
— Some experience with near real-time data processing.

Main responsibilities:

— Development and support of Python applications;
— Solve issues that arise on a daily basis;
— Keep tech solution in the agreed scope and acceptable timing;
— Participate in complex project design teams;
— Work closely with data analysts, data scientists, IT, and business partners;
— Define, design and implement different data ingestion patterns based on business needs and requirements;
— Participate in groomings, demo and other Scrum/Kanban activities;
— Escalate blockers to PM and stakeholders.

What can we offer you:

— Annual leave: 20 working days per year;
— All paid sick days with a doctor’s note (no limit on the number of times. But for 1 time it is paid up to 2 weeks);
— Registration in any format within DiiaCity at the employee’s choice (Employment contract, Gig-contract);
— Individual English classes at EnglishDom online school (compensation within 50% of the amount of expenses);
— €450 / year budget for training and / or sports (compensation within 50% of the amount of expenses) after probationary period;
— Free health insurance after probationary period.

Sounds interesting? Then, apply now, don’t wait up.

SoftConstruct is a cool place to work, where you’ll have fun, make friends, and grow professionally