Overview
The FIT Infrastructure team builds the foundational accelerated compute platforms that power large scale AI training and inference for Microsoft. Our mission is to deliver secure, reliable, and highly efficient GPU infrastructure that enables multi-tenant AI systems at global scale while maximizing utilization, availability, performance, and reliability. This role sits at the intersection of cloud infrastructure, distributed systems software, and frontier AI model serving, working closely with Azure Infrastructure, Microsoft Foundry, Microsoft AI and Microsoft 365 teams to deliver end-to-end platform capabilities. As a a Principal Software Engineering, AI Infrastructure, you will work on mission critical infrastructure that directly powers largescale AI systems. Influence the future of cloud GPU platforms used by internal and external customers and ollaborate with experts across hardware, networking, and AI deployment and serving software. This a an opportunity to grow as a technical leader, shaping long term platform strategy. Microsoft’s mission is to empower every person and every organization on the planet to achieve more, and we’re dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.
Responsibilities
- Develop systems for AI Workload management, scheduling, preemption, and failover.
- Develop systems for AI Workload serving.
- Design and build GPU accelerated infrastructure for training and inference workloads, spanning bare metal, virtual machines, and containerized environments.
- Build and operate advanced orchestration and resource governance scenarios using platforms such as AKS and related Kubernetes ecosystem capabilities to enable fair sharing, isolation, and efficient utilization of accelerated resources.
- Design, Develop, test, and maintain services written in C#, Golang hosted on Kubernetes clusters.
- Optimize performance, reliability, and utilization across large GPU fleets, including scaleup and scale out configurations.
- Drive end-to-end platform features from design through production, including observability, diagnostics, and operational excellence.
- Influence platform architecture and technical direction across teams through design reviews and technical leadership.
- Embody our Culture and Values
Qualifications
Required Qualifications
- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Linux, Go or Python- OR equivalent experience.
Other Requirements
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialize
