Senior Data Python Engineer (вакансія неактивна)

WE ARE: StartupSoft connects top Ukrainian engineers with world-class startups from Silicon Valley and EU. Our developers work directly on the product as an integral part of the startup team.

PROJECT:

Urban SDK, a Techstars company, is a next-generation planning tool that helps smart cities transform mobility, transportation, sustainability, and safety operations with real-time location analytics. They connect public agencies, policy makers, and the community with better data to make more informed policy and budgeting decisions. They enable customers to quickly gather, analyze, and visualize performance indicators to make decisions with a higher degree of confidence.
It’s a mobility analytics platform the main goal of which is to visualize data coming from the physical world (from IoT sensors, smartphones, etc).

PROJECT STACK: Python, AWS;

PROJECT STAGE: founded in 2018;

TEAM: up to 23 people, 1 engineer from our side;

REQUIREMENTS:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Minimum of 8 years of experience in full stack development with a strong focus on frontend and backend technologies.

Must-have:

• Expertise in Python with hands-on experience in Flask, SQLAlchemy, and data processing using Pandas, GeoPandas, and PySpark.
• Proven experience in designing and developing workflow tasking systems, including task automation and management.
• Experience with big data technologies, particularly Apache Spark (PySpark), and handling large-scale data processing.
• Extensive experience with PostgreSQL and PostGIS for geospatial data management.
• Familiarity with shapefiles and their integration into applications.
• Strong problem-solving abilities, excellent communication skills, and the ability to work effectively in a team environment.

Nice to have:

• Proficiency in React and experience with libraries such as Mapbox and Mapbox-GL.
• Experience with Docker and Kubernetes.
• Experience with AWS and cloud service management.
• Knowledge of RabbitMQ for messaging and task queuing

RESPONSIBILITIES:

• Develop and maintain backend services using Python, leveraging Flask for web services, SQLAlchemy for ORM, and other Python packages like GeoPandas, Pandas, and PySpark for data processing and analysis.
• Design and develop workflow-tasking systems to automate and manage complex workflows to build analytics based on anomalies or thresholds.
• Work with csv,geojson, shapefiles and other geospatial data, ensuring proper handling and integration within our applications.
• Utilize big data technologies such as Apache Spark (via PySpark) to process and analyze large datasets. Implement data processing pipelines to handle large file processing.
• Design and optimize flat file data lakes for efficient data management and retrieval in big data contexts.
• Utilize Docker and Kubernetes for containerization and orchestration in our CI/CD pipelines.
• Manage and deploy applications on AWS, leveraging cloud services to enhance application scalability and performance.
• Collaborate with the DevOps team to maintain and enhance infrastructure, ensuring efficient and reliable application operations.
• Work closely with cross-functional teams including UX/UI designers, data scientists, and other developers to deliver high-quality software solutions.
• Provide technical leadership and mentorship to junior developers, fostering a collaborative and innovative work environment.

YOU WILL GET:

• Competitive financial reward and other social benefits;
• Possibility to work with minor supervision and low-bureaucracy;
• Flexible schedule and friendly working atmosphere;
• Tight-knit team with an inclusive and transparent culture.