Software Engineer, Cloud Dataproc, Source

Position: Software Engineer, Cloud Dataproc, Open Source
Job Summary
:
Google is a leading technology company that develops next-generation technologies to enhance user interactions with information. They are seeking a Software Engineer to build customer-facing features for Cloud Dataproc, focusing on performance enhancements and open-source technologies.

Responsibilities
:

• Build high-impact customer-facing features which make Cloud Dataproc the best place to run Hadoop and Spark in the cloud.

• Drive technical design and execution for differentiated Performance and Lake House features and enhancements in an ambiguous problem space.

• Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).

• Enhance Apache Spark for performance, reliability, security, and monitoring, and simultaneously enhance Lake House technologies like Iceberg, Hudi, or Delta Lake for performance, security, and monitoring.

• Contribute to and adapt existing documentation or educational content based on product and program updates, as well as user feedback, while also extending open-source technologies like Apache Spark, Hive, and Trino to improve their debuggability, observability, and supportability.

Qualifications
:
Required
:

• Bachelor’s degree or equivalent practical experience.

• 2 years of experience with performance optimization, systems data analysis, visualization tools, or debugging.

• Experience developing with Spark, Hive, or with similar processing frameworks.

• Experience with Open-Source.

Preferred
:

• Master's degree or PhD in Computer Science or a related technical field.

• Experience developing frameworks such as Apache Spark, Trino, or Flink.

• Knowledge of open-source big-data performance optimization problems.

• Ability to work across boundaries in a distributed team.

Company
:
Google specializes in internet-related services and products, including search, advertising, and software. It is a sub-organization of Alphabet. Founded in 1998, the company is headquartered in Mountain View, USA, with a team of 10001+ employees. The company is currently Late Stage.