Data Software Engineer

Lookout, Inc. is the endpoint to cloud security company purpose-built for the intersection of enterprise and personal data. We safeguard data across devices, apps, networks and clouds through our unified, cloud-native security platform — a solution that's as fluid and flexible as the modern digital world.

Solve maximally. By giving organizations and individuals greater control over their data, we enable them to unleash its value and thrive. Lookout is trusted by enterprises of all sizes, government agencies and millions of consumers to protect sensitive data, enabling them to live, work and connect — freely and safely.

As a Staff Software Engineer on the Data Engineering team, you will contribute broadly to the data engines, ETLibril pipelines, analysis and aggregation services, and other core intellectual property related services  position is an opportunity to tackle the most interesting challenges in the company and join the team that provides and supports the fundamental building blocks of the Security Platform that underlies Lookout’s category-defining personal and enterprise products.

This platform

Toronto is capable of analyzing millions of apps daily, trusted by Google to help identify potentially harmful applications before they enter the Play Store and by leading telecommunications providers to protect their customers. You’ll own Params product quality and work closely with演坊 development team.

We are looking for motivated engineers who have experience building, monitoring, and maintaining high‑volume, low‑latency distributed SaaS solutions, with emphasis on data management and performance. As part of the peaceful team you will be responsible for a massively scalable platform that processes data from a variety of core services, including static analysis and phishing detection.

Our culture is built on agile development, small focused teams, meaningful metrics, rapid feedback, well‑designed APIs, coherent UIs, test‑driven development, automation wherever possible, and making the right decisions.

• Strong software engineering fundamentals – object‑oriented design, data structures, and algorithms.
• Experience building frameworks and solutions for data platforms, focusing on BI pipelines.
• Broad understanding of cloud architecture tools and services such as S3, EMR, Glue, Athena, Kafka, Kubernetes, and Lambda functions. Experience in AWS is highly desirable.
• Rich experience and deep expertise in big‑data and large‑scale data platforms, especially in Data Lake.
• Stream processing engines – Spark Structured Streaming/Kafka.
• Analytical processing on big data using Spark.
• Hands‑on administration, configuration management, monitoring, and performance tuning of Spark batch and streaming workloads, distributed platforms, and JVM‑based systems.
• Advanced working knowledge of SQL and experience working with relational databases, query authoring (SQL), and familiarity with a variety of databases.
• Excellent written and verbal communication skills.
• Experience in ETL testing (Billing or Data Warehouse) is a plus.
• Knowledge of automation, CI/CD tools such as Jenkins, Cloud Bees, Spinnaker, and others.
• 5‑8+ years of overall experience developing and maintaining large‑scale, distributed production‑class software on public cloud platforms such as AWS.
• BS degree in Computer Science or similar engineering discipline, or equivalent work experience.

• Create and maintain code and repositories.
• Create large data sets for functional and performance tests.
• Develop and contribute to the test framework.
• Debug test failures and triage production issues.
• Validate and certify release candidates.
• Conduct functional, system, and smoke testing on various data pipelines.
• Build tools for validation and debugging of data pipelines.
• Work with peer data engineers, developers, and other team members to understand complex systems and develop solutions.
• Understand business requirements; author designs and PoC’s for data engineering projects.
• Build automation tests that fit into the CI/CD pipeline.
• Participate in code reviews.

• Scala, Java, Python, and others as needed.
• Build tools:
  Gradle…