Staff Software Engineer, AI Infrastructure, Google Cloud, Applied AI

Google Cloud’s mission is to make every business successful through AI by combining cutting-edge technology, infrastructure, and talent. AI/ML software engineers in Cloud bridge the gap between pioneering models and a massive product vehicle reaching billions. Our talent density and AI-powered tools drive rapid development, rooted in a culture of empowerment and a bias to action. In this role, you aren’t just building technology; you’re shaping the frontier of enterprise and driving the evolution of advanced models.

As a Staff Software Engineer, you will be passionate about bridging the gap between innovations and reliable, scalable production systems. We are moving beyond prototypes to deliver robust, agentic AI solutions for impactful enterprise use cases.

In this role, you will use your expertise in the end-to-end technology stack—from low-level C++ optimizations to high-level application logic. You will be responsible for landing real-world impact by iterating directly on customer feedback, implementing critical missing features, and architecting the scalable infrastructure required to run sophisticated multi-agent systems at a global enterprise scale.

The Cloud Applied AI (AAI) powers business growth with Gemini Enterprise. Our portfolio includes Gemini Enterprise for Customer Experience (Shopping Agent, CX Agent Studio, Agent Assist, Vertex AI Search - Commerce, Customer Experience Insights), along with other vertical and domain packaged solutions. We enable high adoption and speed to value by building solutions that are quickly deployed, delivering new 0-to-1 capabilities with startup agility. Team members operate at the forefront of AI, collaborating directly with model builders with unprecedented speed. Join us to work on cutting-edge projects and shape the future of AI in a fast-paced, collaborative, and impactful environment.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $262000 - $365000 (USD) + 25% bonus target + bonus + equity + benefits

Learn more about benefits at Google.

Responsibilities

• Architect and build high-performance, distributed infrastructure to support agentic AI workflows. Ensure low-latency agentic systems for real-world enterprise loads.
• Take full ownership of the tech stack, transitioning experimental models into robust production services. Ensure system reliability, observability, and fault tolerance in complex, multi-agent environments.
• Iterate rapidly on customer needs by identifying product gaps and implementing missing features. Translate vague user requirements into concrete, engineering-driven solutions that directly improve the user experience.
• Provide technical guidance on system architecture and code quality.
• Foster a culture of engineering excellence through design reviews, code audits, and the adoption of best practices.

Minimum qualifications:

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience with software development in one or more programming languages (e.g. C++).
• Experience with Artificial Intelligence, Distributed Systems, LLMs and High Performance Computing.

Preferred qualifications:

• Master’s degree or PhD in Computer Science, or a related field with a focus on Systems or AI.
• Experience building and maintaining multi-agent systems or complex applications in an enterprise setting.
• Experience with evaluation frameworks for AI quality in production (e.g., A/B testing, shadow deployment, online learning).
• Ability to navigate ambiguity and iterate quickly on customer feedback to deliver solutions that precisely meet market needs.