AIML - Sr Data Engineer, Evaluation

The SWE Data organization seeks to improve products by using data as the voice of our customers. Within this organization, the Search Data Engineering team builds systems that process data reliably at scale to generate high-quality datasets that support confident, data informed decision-making for improving understanding capabilities of Search capabilities. We're looking for exceptional data engineers who are passionate about our product and values;

who love working with data at scale, and who are committed to continuously improve. As a part of this group, you will work with petabytes of data daily using diverse technologies. You will be expected to effectively partner with upstream engineering u0026 privacy teams and downstream consumers, including data scientists and ML engineers.

In this role, you will be building ultra large scale batch u0026 streaming datasets to support analytics, experimentation and machine learning and helping to drive our self-serve strategy for reporting on-behalf of data scientists and product engineers as we collectively make product better. You will help design instrumentation required to log data from device and server side upholding Apple's privacy promise and validate data is flowing in the correct shape, frequency, and quality into the Data Warehouse.

Curate a high performance and easy to understand data model that meets the needs of the many. Identify common patterns and build self-serve tools to scale data engineering, and automate lifecycle of datasets with the highest standards of data quality. Educate your consumers on how to access your products, assuring transparency and understanding in logic definitions and enabling self-service.

Proficiency in at least one high-level programming language (Python, Java, Scala, Go or equivalent).

Experience with large, complex, highly dimensional data sets; hands-on experience with SQL. Experience working with cross-functional teams to collect business requirements, build consensus, and manage expectations You are self-directed and capable of operating amidst ambiguity. You are humble, continually growing in self-awareness, and possessing a growth mindset. You are curious and have excellent written and verbal communication as well as problem-solving skills.

You are excited about digging into massive petabyte-scale semi-structured datasets. MS or BS in CS, Engineering, Math, Statistics, or a related field or equivalent practical experience in data engineering.

5+ years of technical experience designing, building, and maintaining distributed data processing platforms. 3+ years of industry experience working with batch or streaming distributed data processing technologies (e.g. Spark, Flink, Kafka, Presto, Hadoop, Map Reduce, etc.) for building efficient u0026 large-scale data pipelines. 3+ years of data modeling experience designing data warehouse table schemas and logging schemas.