Senior Software Development Engineer - Data Platform | Remote, Disney+ Hotstar
Hotstar
- Gurgaon, Haryana Bangalore, Karnataka
- Permanent
- Full-time
- You will combine your knowledge of Data Platform technologies with your product sense to solve high scale, high impact and Data relevant use-cases for other product and engineering teams at Hotstar.
- You will work closely with Software Engineers & ML engineers to build Data platform abstractions that fuel the needs of multiple teams, systems and products.
- You will optimize data-delivery and build the infrastructure required for optimal extraction, transformation and loading of data required for a wide variety of use-cases using SQL/Spark.
- You will build stream processing pipelines and tools to support a vast variety of analytics and audit use-cases.
- You will continuously evaluate new and relevant technologies and initiate adoption of new best practices.
- You will influence and drive architecture and design discussions in the Data Platform team.
- You will work in a cross-functional team and collaborate with peers during the entire software development life cycle with a strong focus on continuous deliveryYou will act as a technical mentor and guide for junior team members, fostering a collaborative and growth-oriented work environment.
- Ability to support hyper growth systems across multiple geographies and regions
- In-depth understanding and experience in working with high scale Data lakehouse systems.
- Hands-on experience in Big Data technologies like Apache Spark, SQL, Hadoop, Hive, Airflow, Kafka and Kafka connects.
- Hands-on experience with AWS stack: S3, EMR, RDS etc.
- Strong programming skills in 1 or more of the following languages: Java, Scala, Go, PythonStrong understanding of Database and Data storage fundamentalsStrong understanding of Data storage formats like Parquet, Hudi, Delta etc.
- Excellent teamwork and communication skills, with the ability to work effectively in a fast-paced, agile environment.
- Good to have experience in real-time streaming data pipelines using Spark Streaming or Flink.
- Familiarity with Data lakehouse solutions like Databricks.
- B.Tech/B.E/Masters/PhD in Computer Science from a reputed college or related technical discipline
- 4-6 years of experience in software development, preferably in Data related teams