Senior AI and ML Engineer

NVIDIA is hiring senior software engineers in its Infrastructure Planning and Process Team, to lead the massive scale up in various key solutions for its internal Cloud infrastructure. IPP (Infrastructure, Planning and Process) is a global organization within NVIDIA. The group works with various other teams within NVIDIA such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure needs. These cloud services provide almost half a million automated jobs per day on five thousand servers helping with the productivity of thousands of NVIDIA’s software developers worldwide. The cloud hosts heterogeneous mix of machines and devices with various operating systems (Windows/Linux/Android), multitude of hardware platforms both NVIDIA GPUs and Tegra processors. Are you passionate about infrastructure and looking for complex meaningful issues, ready to build the next generation of cloud services, design creative solutions, mine through data to uncover real problems and fix them? We are excited to have a fun-loving person like you join our team!

As a Senior Software Engineer, you will develop tools and software solutions utilizing large language models and agentic AI to automate workflows and enhance the productivity of engineers across software development, DevOps, and SRE activities.

What you’ll be doing:

• Responsible for implementing AI/ML/DL use cases to improve efficiency in SW development, DevOps and SRE workflows.

• Identify problems related to performance, utilization and scale in existing systems and provide innovative solutions for the same.

• Work with the architect and other developers in internal and external development teams.

What we need to see:

• BE (MS preferred) or equivalent experience in EE/CS with 5+ years of work experience.

• Well versed with Large Language Mode (LLM), Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL) algorithm and techniques.

• Hands-on experience in leveraging large language models (LLMs) and implementing agentic AI for various workflows.

• Expert programming ability in Python, Go or Java.

• Experience in working with SQL/NoSQL database systems such as MySQL, MongoDB or Elasticsearch.

• Good understanding of distributed systems, understanding of microservice architecture and REST APIs.

• Excellent knowledge and working experience with Docker containers. Consistent track record in developing large scale distributed applications.

• Ability to effectively work across organizational boundaries to enhance alignment and productivity between teams.

Ways to stand out from the crowd:

• Expertise in leveraging large language models (LLMs) and Agentic AI to automate complex workflows, with knowledge of retrieval-augmented generation(RAG) and fine-tuning LLMs on enterprise data.

• Knowledge of fine-tuning techniques and hands-on experience, including understanding trade-offs in method selection.

• Prior development of a large software project using service oriented architecture operating with real time constraints.

We have some of the most forward-thinking and versatile people in the world working for us and, due to unprecedented growth, our best-in-class engineering teams are rapidly growing. We are building a team that will truly change the world. If you are passionate about new technologies, care about software quality, and want to be part of the future of transportation and AI, would love for you to join us.

Experience Level

Senior Level