Site Reliability Engineer; SRE - CloudVision

Overview

Arista Networks is an industry leader in data-driven, client-to-cloud networking for large data center, campus and routing environments. What sets us apart is our relentless pursuit of innovation. We leverage the latest advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a competitive edge in an increasingly interconnected world. Our solutions are designed to not only meet the current demands of the digital landscape but to also anticipate and adapt to future challenges.

At Arista we value the diversity of thought and perspectives that each employee brings to the table. We believe that fostering an inclusive environment, where individuals from various backgrounds and experiences feel welcome, is essential for driving creativity and innovation.

Our commitment to excellence has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life Balance. At Arista, we take pride in our track record of success and strive to maintain the highest standards of quality and performance in everything we do.

What You’ll Do:

Cloud Vision is deployed on Kubernetes across global regions using Spinnaker for our CI/CD pipeline. Our tech stack runs on GKE, using HBase/Hadoop as main distributed database and storage layer, Elastic Search for powering search data, Click House for fast real time queries of flow data, our own Kafka-based distributed real time stream processing layer for analytics, and Tensor Flow for ML analysis.

Our monitoring system is built on top of Prometheus, Grafana, Loki, and other OSS tools. As a Senior SRE, you’ll be responsible for our global Cloud Vision service fleet. This includes:

• Build, deploy safely and incrementally and operate critical production systems with focus on scalability, reliability, observability, performance and security.
• Monitor, support and enhance product deployment experience across services.
• Build automation to remove toil and efficiently operate production systems.
• Proactively monitor, respond to, and enhance alerts and set up automated alert handling
• Create and maintain the incident response runbooks.
• Build and deploy new systems with scalability, reliability, and observability as primary requirements
• Triage platform/infrastructural issues and help Arista software engineers in their triages. Engage with 3rd party vendor support.
• Deploy new systems in a staged manner
• Write postmortem documents and build solutions to avoid incidents from repeating.
• Plan and communicate maintenance windows on production systems.
• Work with Arista’s product development teams to identify infrastructural issues that are causing bottlenecks and limitations in their workflows. Design and implement solutions to resolve them.
• Survey and adopt best practices around infrastructure/platform to maintain secure, scalable and fault-tolerant systems.
• Implement solutions to scale the systems
• Implement fault-tolerance and performance to improve availability of the systems
• Study the design and sufficient implementation details of OSS systems for better triage and fix resolution.

• Bachelors in Computer Science or Engineering + 5 years’ experience, MS Computer Science or Engineering + 5 years’ experience, or equivalent work experience.
• Knowledge of one or more of Go, Python, bash shell scripting to be able to implement medium complexity automation workflows.
• Knowledge of Linux (or UNIX) from administration and debugging perspective
• Hands-on experience in operating software systems (infrastructure, complex applications etc) at scale
• Experience in server provisioning (esp from storage and networking perspective).
• Strong problem solving and software troubleshooting skills
• Experience with infrastructure-as-code.
• Desirable to have one/more of the following skills
• Experience managing databases - eg:
  Postgre
  
  SQL or equivalent RDBMS etc
• Experience with docker and virtualization technologies
• Experience managing monitoring stack - Prometheus, Grafanaetc
• Experience managing Artifactory, docker registry etc
• Experience managing CI/CD systems like Git Lab tools, Spinnaker etc
• Experience with infrastructure-as-code frameworks like Terraform
• Experience with container orchestration via Kubernetes

#LI-SZ1