• Experience with big data and distributed data systems (NoSQL, Hadoop, Spark, Hive, etc.)
• Experience with one or more public cloud technologies (preferable GCP, AWS, Azure)
• 2+ years of experience in ETL and streaming technologies like Kafka, Nifi, Flink, Spark SQL, and Spark Streaming
• At least 1 year of experience in Google Cloud services (Data Flow, Data Proc, BigQuery, Pub/Sub)
• Intermediate level of English (or higher)
• Experience with serverless computing (i.e. Lambda, Cloud Functions, Cloud Run, Kubernetes)
• Experience with Python, Java or Kotlin
• Contribute to the design of the database schema and related data movement architecture
• Manage data loading
• Evaluate requirements for their relevancy to and impact on existing models and reference architecture
• Manage and evaluate system enhancements, and resolve system issues
• Improve general refactoring and performance
• Create documentation at all levels
Infopulse is inviting talented professionals to join our team as a Google Cloud data engineer.