The
AGI Data Services organization is responsible for procuring data needed for building and validating large-language models. The vision of the
AGI-DS Experts Program is to efficiently organize upstream and downstream dependencies, implement process and tooling improvements, and stay ahead of industry trends in expert data collections, which require annotators and auditors to hold a graduate degree or higher due to the specialized knowledge needed for the work..
Today,
AGI Data Services leverages expert knowledge to create high-quality data for training and fine-tuning large language models. The program requires coordination across multiple teams, effective dependency management, and continuous process improvement to maximize the value of expert contributions to model performance.
This TPM role's scope includes defining strategy for expert data collection, streamlining processes between upstream and downstream dependencies, and leading
cross-functional development teams from design through delivery. You will be accountable for researching industry trends in expert data collection, identifying gaps in current processes, and communicating your vision for improvements to multiple directors. Most importantly, you will influence engineering teams to build the right solutions for expert data collection. This position involves regular communication with senior management on status, risks and change control. Success requires strong verbal and written communication in email, WBRs, MBRs, PRFAQs, PRDs,
roadmap reviews, and other strategic meetings. Cross-team coordination, project and program management and executive presentation skills are essential.
Key job responsibilities
The Sr. Technical Program Manager will interact with expert contributors, product management, program management, cross partner teams, multiple stakeholders and leadership to deliver complex projects and programs. The person will anticipate bottlenecks in the expert program workflow, provide escalation management, make trade-off decisions, and balance business needs versus technical constraints.
The person should have technical skills to design and implement process and tooling solutions. Successful candidates will have a strong technical background, be detail driven and have excellent problem solving abilities. You will have a deep understanding of expert data collection processes and will successfully represent technical requirements to senior leadership. Your technical expertise and operational excellence will influence the team's decisions and drive robust solutions for expert data collection. They are responsible for bridging experts, technology, process and operations to achieve the right results.
A day in the life
- Collaborate with internal partners to understand their business priorities, communicate outcomes and define roadmaps.
- Define metrics and performance indicators and establish mechanisms to drive them.
- Dive deep into anecdotes and data to find patterns and root causes of problems.
- Dive deep into science, technology and process to identify problems and create solutions. Tirelessly advocate for improvements to systems and processes that will benefit our product teams / stakeholders and business partners.
- Engage with ML Data operations teams to root cause issues, and design solutions.
- 5+ years of technical product or program management experience
- 7+ years of working directly with engineering teams experience
- 3+ years of software development experience
- 5+ years of technical program management working directly with software engineering teams experience
- Experience managing programs across cross functional teams, building processes and coordinating release schedules
- 5+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience
- Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules
- Experience defining KPI's/SLA's used to drive multi-million dollar businesses and reporting to senior leadership
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit
https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, MA, Boston - 148,700.00 - 201,200.00 USD annually