Staff Product Data Scientist, Workspace
- linkCopy link
- emailEmail a friend
Health, dental, vision, life, disability insurance
Retirement Benefits: 401(k) with company match
Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
Sick Time: 40 hours/year (statutory, where applicable); 5 days/event (discretionary)
Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
Baby Bonding Leave: 18 weeks
Holidays: 13 paid days per yearNote: By applying to this position you will have an opportunity to share your preferred working location from the following: New York, NY, USA; Seattle, WA, USA; Sunnyvale, CA, USA.
Minimum qualifications:
- Bachelor's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field.
- 10 years of experience using analytics to solve product or business problems, performing statistical analysis, and coding (e.g., Python, R, SQL) or 8 years work experience with a Master's degree.
Preferred qualifications:
- Master's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field.
- 12 years of experience using analytics to solve product or business problems, performing statistical analysis, and coding (e.g., Python, R, SQL).
About the job
In this role, you will dive deep, dissecting model performance from foundational layers to product specific fine-tuning. You will balance how to blend techniques like autoratings, classic human eval, and reveal preference modeling to illuminate where we need to do better, and where we are doing well. Your findings will drive cross-organizational engineering efforts, shaping the very core of our AI-powered future. You will have the opportunity to work with technology and contribute to the development of a product that has the potential to transform the way people work.The US base salary range for this full-time position is $183,000-$271,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.Responsibilities
- Conduct evaluations of our model performance, focusing on productivity-related tasks and workflows across modalities (text, video, images, speech).
- Develop and implement evaluation frameworks and metrics to assess the model's strengths and weaknesses.
- Analyze evaluation data and generate reports to communicate findings to leadership.
- Collaborate closely with research and engineering teams to identify areas for improvement and contribute to the development of new evaluation methodologies.
- Stay up-to-date with the latest advancements in LLM technology and evaluation techniques, and be conversant in (and understand the shortcomings of) industry benchmarks.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.