Senior System Software Engineer - AI


July 21, 2021

We are now looking for Senior System Software Engineer to work on Triton Inference Server team!
Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in problems from image classification to speech recognition to natural language processing. We are a fast-paced team building tools and software to make design and deployment of new deep learning models easier and accessible to more data scientists.
What you'll be doing:
In this role, you will develop software to serve predictions from trained neural networks running on GPUs. You will contribute to the project as an active developer and team leader. As a developer, you will balance a variety of objectives: build robust software that can be deployed in production servers or cloud settings; understand new customer use cases; work with product teams to define new capabilities; load-balance asynchronous requests across available resources; optimize prediction throughput under latency constraints; and integrate the latest open source technology. As a team lead, you will be encouraged to help set project priorities; mentor junior engineers; work with customers, partners, and management to align key objectives. More information on Triton Inference Server can be found here: https://github.com/triton-inference-server/server
What we need to see:

  • Masters or PhD or equivalent experience in Computer Science, computer architecture, or related field and 7+ years of experience

  • Ability to work independently, define project goals and scope, interact directly with open source community, and lead your own development effort

  • Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design. Python experience also useful

  • Distributed systems programming

  • Excellent troubleshooting abilities spanning multiple software (storage systems, kernels and containers)

  • Experience contributing to a large open source project - use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc.

  • Experience building and deploying cloud services using HTTP REST, gRPC, protobuf, JSON and related technologies

Ways to stand out from the crowd:

  • Experience with machine learning algorithms and frameworks. Especially experience frameworks such as PyTorch, Tensorflow, ONNX Runtime, and TensorRT

  • Experience with container technologies, such as docker, singularity, and LXC

  • Experience with containers orchestrators as Kubernetes, Docker Swarm, Mesos or Nomad

  • Knowledge of GPU programming such as OpenCL or CUDA

  • Occasional travel to conferences and for customer visits may be required

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. Come help us build the real-time, efficient computing platform driving our success in the dynamic and quickly growing field Deep Learning and Artificial Intelligence.
The Colorado Equal Pay for Equal Work Act requires that NVIDIA provide the compensation range and benefits offered for this position if performed in Colorado. The base salary range for this position in Colorado is $190,800.00 - 262,350.00 USD.
NVIDIA also offers a comprehensive benefits package. We provide health care coverage, dental and vision, 401(K), including company matching and after tax contributions, Employee Stock Purchase Program (ESPP), Employee Assistance Program (EAP), company paid holidays, paid sick leave, vacation leave, professional time off, life and disability protection. Employees in eligible sales and positions may also be eligible for commission.
Base pay is based on market location and may vary based on factors including experience, skills, education, and other job-related reasons.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression , sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.