Job description

Overview Core AI is at the forefront of Microsoft’s mission to redefine how software is built and experienced. We are responsible for building the foundational platforms, services, programming models, and developer experiences that power the next generation of applications using Generative AI. Our work enables developers and enterprises to harness the full potential of AI to create intelligent, adaptive, and transformative software. Within Core AI, the CloudMine team plays a critical role in enabling engineering excellence across Microsoft. We build and operate the data platform that serves key engineering artifacts—such as pull requests, work items, and build telemetry—to production teams. This data fuels essential security, compliance, and productivity analyses across Windows, Azure, and other major product lines. As a Senior Software Engineer on the CloudMine team, you will be instrumental in designing, maintaining, and evolving the data mining framework and pipelines that support a wide range of engineering initiatives—from Windows shiproom operations to security and compliance enforcement, engineering productivity programs, and AI impact analyses. In this role, you will architect and optimize scalable data pipelines and mining frameworks, ensuring they are robust, efficient, and secure. You’ll curate high-quality datasets that support critical decision-making across multiple teams, while also conducting in-depth performance analyses to continuously improve data delivery and system responsiveness. Your work will include developing new data collectors and integrations across engineering systems, and ensuring the security, reliability, and compliance of the data platform itself. Success in this role requires versatility across software engineering, data engineering, and analytics. You should bring a strong passion for data quality, performance, and impact, along with experience working with large-scale data systems and distributed architectures. A collaborative mindset and eagerness to work across teams and disciplines will be key to thriving in this position. At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Responsibilities Architect for Scale and Sustainability : Design and evolve durable, scalable system architectures that balance long-term maintainability with short-term delivery needs, making thoughtful engineering trade-offs. Direct Impact: Leads by example and work with others to produce extensible and maintainable code used across the platform. Creates and applies metrics to drive the quality and stability of code, as well as appropriate coding patterns and best practices. Foster Engineering Alignment: Build consensus across engineering teams and partner organizations by driving clarity, alignment, and shared ownership of technical direction. Build Foundational Capabilities: Contribute to and lead the development of core platform components and reusable building blocks that accelerate team velocity and product innovation. Champion Customer-Centric Development: Engage directly with customers and product teams to capture feedback, understand demand signals, and refine product messaging—ensuring the voice of the customer shapes product evolution. Operational Excellence: Drive operational excellence in managing and operating large-scale data systems with a high bar for data quality, stability, security and privacy. Set high standards for reliability and performance. Qualifications Required Qualifications: • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Other Requirements: • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years Preferred Qualifications: • 3+ years of experience working on data mining and data pipelines. • 2+ years of experience in leading and driving engineering projects, planning, executing, and overseeing engineering initiatives with a focus on collaboration, efficiency, and achieving key milestones. • Experience and expertise working with Microsoft Azure and data products such as Microsoft Fabric, Databricks, or similar. Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: careers.microsoft.com This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Requirements

Must-haves

Architect for Scale and Sustainability : Design and evolve durable, scalable system architectures that balance long-term maintainability with short-term delivery needs, making thoughtful engineering trade-offs.
Foster Engineering Alignment: Build consensus across engineering teams and partner organizations by driving clarity, alignment, and shared ownership of technical direction.
Build Foundational Capabilities: Contribute to and lead the development of core platform components and reusable building blocks that accelerate team velocity and product innovation.
3+ years of experience working on data mining and data pipelines.
2+ years of experience in leading and driving engineering projects, planning, executing, and overseeing engineering initiatives with a focus on collaboration, efficiency, and achieving key milestones.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Nice-to-haves

Experience and expertise working with Microsoft Azure and data products such as Microsoft Fabric, Databricks, or similar.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aiazurejavajavascriptpython

Platform: eightfold
Effort: medium