Splunk

Cloud Service Group Site Reliability Engineer (Remote)

Splunk

April 28, 2021


Job Description
Join us as we pursue our disruptive vision to make machine data accessible, usable and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we’re committed to our work, customers, having fun and most significantly to each other’s success. Learn more about Splunk careers and how you can become a part of our journey!
Role:
Splunk's Cloud Services group is looking for a Site Reliability Engineer to help lead, design and build the next generation of our large scale cloud offering. You will be working on core services and applications that form the primitives for our current and future cloud service offerings. Site Reliability Engineers in this role will be engaging with multiple service owners across the platform to teach and implement modern interpretations of SRE, observability, Chaos Engineering and DevOps. This role is highly visible and impactful to the organization and will help shape Splunk's Engineering culture for years to come. Your job, in a nutshell, is to make every team around you better... including your own!

You will:

  • Work across the organization to deliver quality products that delight Splunk's passionate users.
  • Build tools and design processes that help improve observability and system resiliency of the SignalFx Platform.
  • Triage Site Availability Incidents and proactively work towards reducing MTTR for customer impacting incidents.
  • Partner with Service owners to implement Service Level Metrics & Service Level Objectives that act as service level health indicators.
  • Establish design patterns for monitoring, benchmarking and deploying new features for the backend services.
  • Abide by all of the FedRAMP security controls on Splunk Cloud environments.
  • Work across the organization to deliver quality products that delight Splunk's passionate users.
  • Lead teams of tight-knit engineers who are building a state-of-the-art, cloud-based environment for massive-scale data processing.
  • Mentor and help new engineers to achieve more than they thought possible. You enjoy making other teams successful and are fulfilled through the success of others.
Qualifications:
  • Experience monitoring and troubleshooting Splunk environments..
  • Experience in administering or architecting distributed Splunk environments.
  • Experience with the development and deployment of a hosted cloud environment, preferably AWS and GCP.
  • Experience with Python or Shell for scripting, and Git or similar version control systems.
  • Experience supporting customer facing SaaS infrastructure or similar cloud related services.
  • You enjoy building and running distributed systems at scale in production. You understand the challenges and trade-offs to be made when building and deploying systems to production.
  • Expertise in working with container deployment and orchestration technologies at scale with knowledge of fundamentals including service discovery, deployments, monitoring, scheduling, load balancing. Knowledge of Kubernetes, Go and Docker preferred.
  • Deep understanding of Systems programming (network stack, file system, OS services) and networking (L2 vs. L3, network architecture, VLANs, etc)
  • Knowledge of standard methodologies related to security, performance, and disaster recovery.
  • Highly skilled in identifying performance bottlenecks, identifying anomalous system behavior, and resolving root cause of service issues.
  • You've demonstrated the skills to effectively work across teams and functions to influence design, operations and deployment of highly available software.
  • You work hard to make the users of Splunk's products happier every day.
  • Ability to work nights, weekends, and swing shifts.
  • This is a FULLY REMOTE, US-based position. We encourage applicants anywhere in the US! You must be a US Citizen working on US soil to be considered.
Preferred skills:
  • Experience with large scale distributed cloud service development, infrastructure, traffic management and architecture.
  • Experience with distributed architectures/systems with optimized and scalable software that operates on a large number of nodes.
  • Ability to obtain a favorably adjudicated Single Scope Background Investigation (SSBI) and SECRET clearance

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying. For job positions in San Francisco, CA, and other locations where required, we will consider for employment qualified applicants with arrest and conviction records.