Microsoft Logo

Microsoft

Principal Software Engineer - CoreAI

Reposted 17 Hours Ago
Be an Early Applicant
In-Office
Mountain View, CA, USA
143K-304K Annually
Senior level
In-Office
Mountain View, CA, USA
143K-304K Annually
Senior level
Design, build, and operate production-grade generative and multimodal AI systems. Lead technical design for core GenAI capabilities (RAG, context/memory, orchestration), define evaluation frameworks and telemetry, ensure security/compliance alignment, mentor engineers, and partner with product and customers to deliver enterprise APIs and developer experiences.
The summary above was generated by AI
Overview

You will work in a group focusing on advancing Azure Content Understanding, a multimodal AI capability that enables organizations to transform unstructured data—such as text, documents, audio, images, and video—into structured, actionable insights.  

As a Principal Engineer on the team, you will work on building end‑to‑end multimodal AI systems that process and extract insights from diverse multi-modality data types. In this role, you will combine strong software engineering with applied ML expertise to design and ship production systems using techniques like context engineering, data generation and rigorous evaluation/metrics to continuously improve quality.  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more, and we are dedicated to this mission across every aspect of the company. Our culture us centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.


Responsibilities
  • Design, build, and operate production-grade generative AI and multimodal systems, with end-to-end ownership from concept through deployment and service operations.  

  • Lead technical design for core GenAI capabilities (e.g., retrieval-augmented generation, context and memory, orchestration) and make data-driven tradeoffs across quality, latency, cost, and safety.  

  • Define and improve model and system quality using evaluation frameworks, experiment design, and production telemetry; ensure robust testing and regression coverage.  

  • Collaborate with security, privacy, and compliance partners to build solutions that meet enterprise requirements and align with Responsible AI standards and practices.  

  • Provide technical leadership across teams by setting direction, reviewing designs, unblocking execution, and mentoring engineers on architecture, coding standards, and ML engineering best practices.  

  • Partner with product and customers to understand scenarios, translate requirements into well-designed APIs and developer experiences, and drive adoption through documentation and samples.  


Qualifications

Required Qualifications:

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.


Other Requirements:

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
    • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

  • Advanced degree in Computer Science, Machine Learning, or related field.  

  • Demonstrated technical leadership through influence (e.g., leading designs, setting architecture direction, mentoring engineers).  

  • Experience with prompt engineering, retrieval-augmented generation (RAG), and memory/agent frameworks.  

  • Experience building and shipping generative AI systems (including multimodal scenarios).  

  • Familiarity with compliance and security standards in enterprise AI solutions.  

  • Track record of delivering enterprise-facing AI products at scale.  

  • Experience building and operating ML/AI systems in cloud environments; familiarity with MLOps practices (Azure a plus).  

  • Experience partnering with cross-functional stakeholders to define requirements and drive technical decisions.


#CoreAI


Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Microsoft Mountain View, California, USA Office

1065 La Avenida, Mountain View, CA 94043, Mountain View, United States, 94043

Microsoft Palo Alto, California, USA Office

Palo Alto, United States

Microsoft San Francisco, California, USA Office

835 Market Street, Suite 700, San Francisco, CA 94103, San Francisco, United States, 94103

Microsoft San Jose, California, USA Office

San Jose, United States

Microsoft Sunnyvale, California, USA Office

Sunnyvale, United States

Similar Jobs

2 Days Ago
In-Office
143K-304K Annually
Senior level
143K-304K Annually
Senior level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Lead design and delivery of large-scale AI observability services for Core AI. Own end-to-end development, production readiness, and DevOps practices; collaborate with product, partners, and customers; innovate on reliability, performance, and monitoring for generative AI agent platforms.
Top Skills: AICC#C++Cloud ServicesDevOpsDistributed SystemsGoJavaJavaScriptMachine LearningObservabilityPython
23 Days Ago
In-Office
Mountain View, CA, USA
143K-331K Annually
Senior level
143K-331K Annually
Senior level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Design, build, and scale cloud-native distributed systems and runtimes to deploy, run, fine-tune, and observe enterprise AI agents. Drive architecture, optimize model/infrastructure interactions, improve developer iteration tooling, enforce secure-by-design practices, and mentor engineering teams to deliver production-ready agent platforms.
Top Skills: AzureCC#C++Cloud-NativeDistributed SystemsFine-TuningGenerative AiJavaJavaScriptMachine LearningObservabilityPython
5 Days Ago
In-Office
Mountain View, CA, USA
143K-331K Annually
Senior level
143K-331K Annually
Senior level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Lead architecture and development of a high-scale experimentation platform for AI products. Drive cross-team technical direction, ensure scalability, reliability, security, and mentor senior engineers while owning live-site operations and incident retrospectives.
Top Skills: A/B TestingAWSAzureCC#C++Distributed TracingExperimentation PlatformsGCPJavaJavaScriptLoggingMetricsPython

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account