Microsoft Logo

Microsoft

Applied Scientist II / Senior Applied Scientist - Responsible AI (CoreAI)

Posted 6 Hours Ago
Be an Early Applicant
In-Office
2 Locations
102K-261K Annually
Senior level
In-Office
2 Locations
102K-261K Annually
Senior level
Design, train, and evaluate Responsible AI components: fine-tune LLMs (including RLHF), build adversarial agent evaluations and safety mitigations, collaborate with engineering to deploy mitigations at scale, monitor operational performance, and troubleshoot end-to-end issues.
The summary above was generated by AI
Overview

The CoreAI Platform and Tools organization is building transformative experiences that leverage the latest AI technology while upholding Microsoft’s commitment to ethical and responsible standards for Artificial Intelligence. The Responsible AI (RAI) service components you build will be accessed by hundreds of millions of consumers across the globe and will touch all facets of Artificial Intelligence. The Responsible AI team within this division is looking for  an experienced Applied Scientist II and a Senior Applied Scientist with a proven track record to help tackle the challenges of enabling customers to leverage the latest advancements in AI responsibly.


Responsibilities
  • Conduct supervised fine-tuning of LLMs, applying Reinforcement Learning from Human Feedback in the process, and conducting thorough evaluation of those.
  • Work with tech lead on the design and implementation of Agent adversarial evaluations and safety mitigations, enabling agent creators to identify potential risks and apply appropriate safeguards to ensure the safety and security of Agents.
  • You will collaborate closely with the Responsible AI engineering team to deliver these mitigations at scale for Responsible AI customers, refine existing implementations based on operational performance, and troubleshoot and resolve end-to-end issues. 

Qualifications

Required Qualifications:

  • Bachelor's Degree in Computer Science, Computational Linguistics, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)
  • OR Master's Degree in Computer Science, Computational Linguistics, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
  • OR Doctorate in Computer Science, Computational Linguistics, or related field
  • OR equivalent experience.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.


Preferred Qualifications:

  • Master's Degree in Computer Science, Computational Linguistics, related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Computer Science, Computational Linguistics, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience.
  • 2+ years of science experience owning feature design, model development, evaluation and deployment.
  • 3+ years of science experience owning feature design, model development, evaluation and deployment. Full stack (client-to-service) development experience is a plus. 
  • Rich experience in machine learning, particularly in NLP and deep learning. 
  • Experience with language model training and evaluation is a big plus. 
  • Experience with research in Responsible AI is a big plus. 
  • Proficiency in programming languages such as Python, C#, and familiarity with machine learning frameworks including PyTorch and Triton. 
  • Experience with data processing and handling large datasets. 
  • Experience in engineering methodologies: Unit testing, Test Driven Development, DevOps, and a firm commitment to quality. 
  • Solid platform/API design, debugging and data analysis skills. 
  • Ability to work collaboratively in a team and communicate complex concepts effectively.

#coreai


Applied Sciences IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Microsoft Mountain View, California, USA Office

1065 La Avenida, Mountain View, CA 94043, Mountain View, United States, 94043

Microsoft Palo Alto, California, USA Office

Palo Alto, United States

Microsoft San Francisco, California, USA Office

835 Market Street, Suite 700, San Francisco, CA 94103, San Francisco, United States, 94103

Microsoft San Jose, California, USA Office

San Jose, United States

Microsoft Sunnyvale, California, USA Office

Sunnyvale, United States

Similar Jobs

An Hour Ago
Remote or Hybrid
United States
50K-60K Annually
Junior
50K-60K Annually
Junior
Artificial Intelligence • Healthtech • Logistics • Social Impact • Software • Telehealth
Support in-home clinical leadership by managing workforce and payroll compliance, tracking attendance and training, preparing operational reports, maintaining SOPs and dashboards, routing non-clinical issues, and participating in audits to ensure HIPAA and policy adherence.
Top Skills: Ehr SystemsGoogle DocsGoogle SheetsGoogle SlidesRipplingSlack
An Hour Ago
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
198K-341K Annually
Senior level
198K-341K Annually
Senior level
Fintech • Mobile • Software • Financial Services
The Principal Engineer will lead the Digital Identity group, architect solutions for complex problems, and ensure operational excellence by establishing processes and mentorship for the team.
Top Skills: AIDistributed SystemsIdentity Authorization
An Hour Ago
In-Office or Remote
159K-273K Annually
Expert/Leader
159K-273K Annually
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead payor contracting strategy and negotiations for the Washington market, oversee contract implementation and payor performance, partner with finance and network teams, drive business development, ensure compliance, and manage/direct contracting and revenue cycle teams to meet reimbursement and growth objectives.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account