Back to search

Data Engineer || 2-5 YOE || Gaming Industry || Pune

Pune Permanent View Job Description
Seeking a highly skilled and motivated Data Engineer The ideal candidate will have strong expertise in Python, Apache Spark, Apache Flink, BigQuery, Google Cloud Dataproc/ Databricks, and Confluent Kafka. Will be responsible for designing, developing, and optimizing large-scale data processing systems, enabling real-time and batch data workflows to support business intelligence and advanced analytics.
  • Opportunity to work with industry leaders
  • Career growth opportunity

About Our Client

This company is a leading player in the mobile gaming and esports industry, offering a platform that enables users to enjoy a wide variety of skill-based games and compete in tournaments for real-world rewards. Known for its innovation and rapid growth, the company has attracted millions of users worldwide and continues to push the boundaries of interactive entertainment.

Job Description

1. Data Pipeline Development

  • Design, implement, and maintain scalable ETL pipelines using Apache Spark, Apache Flink, Dataproc, and Confluent Kafka.



2. Confluent Kafka Integration

  • Architect and manage Confluent Kafka-based solutions for real-time data ingestion and distribution.



3. Big Data Frameworks

  • Develop distributed data processing solutions leveraging Spark and Flink for complex transformations, aggregations, and analysis.



4. Google Cloud Platform Expertise

  • Utilize BigQuery for efficient querying and analytics over large-scale datasets, particularly key-value structured data from gaming events.



5. Programming and Scripting

  • Write clean, efficient, and reusable code in Python for data processing and integration tasks.



6. Collaboration and Stakeholder Management

  • Work closely with the Head of Engineering, data scientists, analysts, and game developers to understand requirements and deliver actionable insights.



7. Performance Optimization

  • Optimization Monitor and tune performance for distributed systems to ensure low-latency and high-throughput data processing, critical for gaming event data.

The Successful Applicant

  • Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Programming: Proficiency in Python with experience in writing production-level
  • Big Data Technologies: Hands-on experience with Apache Spark and Apache Flink for batch and streaming data processing.
  • Kafka: Proven experience with Confluent Kafka for real-time data ingestion, topic design, partitioning, and stream processing.
  • Cloud Platforms: Strong knowledge of Google Cloud Platform (G), including BigQuery,Dataproc and related services.
  • SSkills: Expertise in writing complex SQLqueries and optimizing them for large
  • Data Engineering Concepts: Solid understanding of distributed systems,,modeling partitioning, and schema design.

What's on Offer

Opportunity to work with industry leaders

Career growth opportunity

Quote job ref
JN-012025-6638552

Job summary

Function
Analytics
Sub Sector
Data Analytics
What is your area of specialisation?
Leisure, Travel & Tourism
Location
Pune
Job Type
Permanent
Job Reference
JN-012025-6638552

Diversity & Inclusion at Michael Page

We don't just accept difference - we celebrate it. We encourage applicants from all backgrounds to apply for this role and are committed to building inclusive, diverse workplaces where everyone can thrive. If you require any support or reasonable adjustments during the recruitment process, please let us know.

OSZAR »