Core AI is at the forefront of Microsoft’s mission to redefine how software is built and experienced. We are responsible for building the foundational platforms, services, programming models, and developer experiences that power the next generation of applications using Generative AI. Our work enables developers and enterprises to harness the full potential of AI to create intelligent, adaptive, and transformative software.
Within Core AI, the CloudMine team plays a critical role in enabling engineering excellence across Microsoft. We build and operate the data platform that serves key engineering artifacts—such as pull requests, work items, and build telemetry—to production teams. This data fuels essential security, compliance, and productivity analyses across Windows, Azure, and other major product lines.
As a Senior Software Engineer on the CloudMine team, you will be instrumental in designing, maintaining, and evolving the data mining framework and pipelines that support a wide range of engineering initiatives—from Windows shiproom operations to security and compliance enforcement, engineering productivity programs, and AI impact analyses.
In this role, you will architect and optimize scalable data pipelines and mining frameworks, ensuring they are robust, efficient, and secure. You’ll curate high-quality datasets that support critical decision-making across multiple teams, while also conducting in-depth performance analyses to continuously improve data delivery and system responsiveness. Your work will include developing new data collectors and integrations across engineering systems, and ensuring the security, reliability, and compliance of the data platform itself.
Success in this role requires versatility across software engineering, data engineering, and analytics. You should bring a strong passion for data quality, performance, and impact, along with experience working with large-scale data systems and distributed architectures. A collaborative mindset and eagerness to work across teams and disciplines will be key to thriving in this position.
At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
Architect for Scale and Sustainability: Design and evolve durable, scalable system architectures that balance long-term maintainability with short-term delivery needs, making thoughtful engineering trade-offs.
Direct Impact: Leads by example and work with others to produce extensible and maintainable code used across the platform. Creates and applies metrics to drive the quality and stability of code, as well as appropriate coding patterns and best practices.
Foster Engineering Alignment: Build consensus across engineering teams and partner organizations by driving clarity, alignment, and shared ownership of technical direction.
Build Foundational Capabilities: Contribute to and lead the development of core platform components and reusable building blocks that accelerate team velocity and product innovation.
Champion Customer-Centric Development: Engage directly with customers and product teams to capture feedback, understand demand signals, and refine product messaging—ensuring the voice of the customer shapes product evolution.
Operational Excellence: Drive operational excellence in managing and operating large-scale data systems with a high bar for data quality, stability, security and privacy. Set high standards for reliability and performance.
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Other Requirements:
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Preferred Qualifications:
- 3+ years of experience working on data mining and data pipelines.
- 2+ years of experience in leading and driving engineering projects, planning, executing, and overseeing engineering initiatives with a focus on collaboration, efficiency, and achieving key milestones.
- Experience and expertise working with Microsoft Azure and data products such as Microsoft Fabric, Databricks, or similar.
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Microsoft Mountain View, California, USA Office
1065 La Avenida, Mountain View, CA 94043, Mountain View, United States, 94043
Microsoft Palo Alto, California, USA Office
Palo Alto, United States
Microsoft San Francisco, California, USA Office
835 Market Street, Suite 700, San Francisco, CA 94103, San Francisco, United States, 94103
Microsoft San Jose, California, USA Office
San Jose, United States
Microsoft Sunnyvale, California, USA Office
Sunnyvale, United States
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
