Senior Software Engineer, Search Platforms, LLM Evaluation Infrastructure

About the job

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

At Google, our mission is to organize the world's information and make it universally accessible and useful. The Search Platforms Large Language Model (LLM) Evaluation Infrastructure team is at the forefront of this mission, building the next-generation core infrastructure and benchmarking platforms that power robust, automated, and scalable LLM evaluations across Google Search.

As a Senior Software Engineer, you will lead the architecture, design, and implementation of LLM evaluation platforms and continuous benchmarking pipelines. You will transform complex, bespoke evaluation workflows into a unified, high-throughput platform capable of assessing quality, factual accuracy, safety, and latency across advanced model architectures. You will be responsible for creating and evolving scalable, reproducible back-end evaluation infrastructure for systems operating at a massive global scale.In Google Search, we're reimagining what it means to search for information – any way and anywhere. To do that, we need to solve complex engineering challenges and expand our infrastructure, while maintaining a universally accessible and useful experience that people around the world rely on. In joining the Search team, you'll have an opportunity to make an impact on billions of people globally.