at Google
Location
Mountain View, CA, USA
Compensation
$174k–$253k USD
Type
full time
Posted
4 days ago
Market range · company + function + seniority
p25 · target · p75 · n=640
Posted $253k · in the market band
Tailor your résumé to this role in 30 seconds.
Free account · ATS keyword check · per-job bullet rewrite by Claude.
As a member of this team, you will be at the forefront of Google Search, pioneering the evaluation of groundbreaking AI products. We provide the essential groundwork for Search’s primary Generative AI products, including AI overview and AI mode. By developing SOTA AI Raters and advanced measurement frameworks, we try to ensure high quality for AI-generated responses. We work on the most complex challenges in AI quality, architecting novel ways for billions of users to experience Google’s capabilities on a daily basis. This is a unique opportunity to shape and refine the future of state-of-the-art Search AI products at Google.
In this role, you will evaluate and improve the Google Search user experience. We work on challenging problems at the frontiers of Generative AI evaluation, and collaborate cross-functionally. We use available data sources (human ratings, offline eval, live experiments, user surveys, etc.) to bring analytical accuracy and statistical methods to the challenges of measuring quality, developing metrics, and improving training data for model development.
As a key member of the team, you work with engineers and researchers to analyze/interpret data, develop metrics, and integrate new methodologies into existing evaluation systems.
More open roles at Google
Hiring velocity, headcount trend, and every open posting on one page.
Open postings ranked by description similarity — useful if this role isn't quite right.