Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 5 years of experience managing projects and defining project scope, goals, and deliverables.
- 5 years of experience in data analysis, working with databases, and querying (e.g., SQL, MySQL, MapReduce).
Preferred qualifications:
- Experience working with abuse, spam, fraud or malware.
- Experience working on product policy analysis and identifying policy risks.
- Experience using statistical analysis and hypothesis testing.
- Experience analyzing ML models performance or working on Large Language Models (LLMs).
- Excellent problem-solving and critical thinking skills with attention to detail in an ever-changing environment.
About the job
Kids and Learning Trust and Safety team will work alongside product, engineering and policy teams to proactively understand risk for evolving GenAI experiences, detect harm patterns, develop Applied AI solutions to handle novel trust problems and define industry best practices. This is an exciting opportunity to be part of unlocking safe access to Gen AI experiences for global youth, which is a company level priority.
Gaining and retaining user trust is critically important to Google’s success. We defend Google's integrity by fighting spam, fraud and abuse, and develop and communicate product policies. The Trust and Safety team reduces risk and protects the experience of our users and business partners across Google's expanding base of products. We work with a variety of teams from Engineering to Legal and Public Policy to set policies and combat fraud and abuse at scale, often with an eye to finding industry-wide solutions. Trust and Safety team members are motivated to find innovative solutions, and use technical know-how, user insights and proactive communication to pursue the highest possible quality and safety standards for users across Google products. This role works with sensitive content or situations and may be exposed to graphic, controversial, and/or upsetting topics or content.
At Google we work hard to earn our users’ trust every day. Trust & Safety is Google’s team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google’s products, protecting our users, advertisers, and publishers across the globe in over 40 languages.
Responsibilities
- Perform complex data analyses to derive insights that help identify and fight abuse across our products. Use technical judgment to drive project delivery, challenge proposals and identify risks. Develop datasets and run evals for engineers to evaluate and improve Search and Learning Gen AI products.
- Enhance our operational workflows via process improvements and identification of automation opportunities. Help to establish metrics to benchmark Generative-AI issues in the learning space and quantify improvements.
- Improve classifiers, base model level safety through data analysis, technical expertise, and gain consensus from key stakeholders. Analyze and debug escalations and identify trends that can indicate bigger product risks.
- Collaborate with teams and functions such as Engineering, Product Management, Policy, Responsible AI Testing, etc. among many others.