Senior Staff Software Engineer, ML Infrastructure, Agents Infrastructure

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

Applied AI builds conversational agents deployed at a large scale that achieve very meaningful results in the real world. Some examples include the customer agent built for large call center environments, to fast food ordering handled by our Food AI agent. The team is transforming how enterprises connect with customers through the power of AI. We also offer unique experiences for team members where you get to work directly with the model builders (Google DeepMind / Vertex), learn and work with brilliant AI leaders, and have access to Global 1000 customers via our existing Google Cloud relationships. The opportunity in this space is tremendous.

Responsibilities

• Lead the design and implementation of back-end services and the Agent API, abstracting complex Google Cloud Platform (GCP) infrastructure into a modern, asynchronous, event-driven framework.
• Build the infrastructure for seamless communication and autonomous tool-use, enabling specialized agents to interact with APIs and databases to solve complex, multi-step goals.
• Develop "always-on" analysis systems that ingest and reason over massive data streams from hundreds of disparate sources, including Enterprise Resource Planning (ERPs), Customer Relationship Management (CRMs), and unstructured documents.
• Implement robust frameworks for monitoring, tracing, and explainability to ensure all agentic actions are transparent, auditable, and reliable for enterprise customers.
• Partner with Vertex AI and Google DeepMind to leverage, integrate, and influence the future roadmap of Google’s core agent frameworks and AI models.

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience leading technical project strategy, ML design, and optimizing industry-scale ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 5 years of experience with design and architecture; and testing/launching software products.
• 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).

Preferred qualifications:

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 8 years of experience with data structures and algorithms.
• 5 years of experience in a technical leadership role leading project teams and setting technical direction.
• 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.