Loading...
Sr. Software Dev Engineer, Alexa AI Logistics for Infrastructure, Cost, & Efficiency
Amazon
On-siteseniorPosted May 12, 2026
About the Role
Serve as the technical anchor for the India team, driving architecture decisions for LLM inference components, designing and implementing scalable systems, and leading technical design reviews while ensuring operational excellence.
Requirements
Requires technical leadership in designing and implementing scalable, high-availability systems for LLM inference serving, driving architectural decisions, and ensuring operational excellence for Tier-1 production services. The role involves mentoring junior SDEs and collaborating across teams.
Full Job Description
Are you passionate about building and operating the world's largest real-time LLM inference systems? Are you a technical leader who thrives in high-ambiguity environments and wants to drive architectural decisions that impact millions of Alexa customers daily? If so, the Alexa AI Logistics for Infrastructure, Cost, and Efficiency (ALICE) team is looking for a Senior Software Development Engineer to join our new India team and own critical components of Alexa's LLM inference infrastructure.
Alexa is shaping the future of AI voice-based personal assistants. At ALICE, we are passionate about infrastructure efficiency, cost optimization, and capacity management to enable amazing customer experiences at scale. You will be a founding technical leader of our India presence, setting the bar for engineering excellence and driving high-impact work on one of Amazon's most critical AI services.
Key job responsibilities
- Serve as the technical anchor for the ALICE India team, driving architecture decisions for the AlexaLLMInferenceService (LLMI) and related ALICE portfolio services
- Design and implement scalable, high-availability systems for LLM inference serving, including multi-node distributed inference and multi-tenancy capabilities
- Lead technical design reviews, set coding standards, and mentor junior SDEs on the team
- Make technical trade-offs between short-term team needs and long-term business needs, with a focus on performance, cost, and reliability
- Collaborate with ALICE teams in Seattle and partner teams across Alexa and AGI on cross-cutting infrastructure programs
- Drive operational excellence for Tier-1 production services, including on-call ownership, incident response, and continuous improvement
- Influence the broader ALICE software architecture and contribute to org-wide technical strategy
A day in the life
As the Senior SDE, you will be the technical lead for the India team, owning architecture decisions for LLMI components and contributing to ALICE's broader portfolio of infrastructure optimization products.
Alexa is shaping the future of AI voice-based personal assistants. At ALICE, we are passionate about infrastructure efficiency, cost optimization, and capacity management to enable amazing customer experiences at scale. You will be a founding technical leader of our India presence, setting the bar for engineering excellence and driving high-impact work on one of Amazon's most critical AI services.
Key job responsibilities
- Serve as the technical anchor for the ALICE India team, driving architecture decisions for the AlexaLLMInferenceService (LLMI) and related ALICE portfolio services
- Design and implement scalable, high-availability systems for LLM inference serving, including multi-node distributed inference and multi-tenancy capabilities
- Lead technical design reviews, set coding standards, and mentor junior SDEs on the team
- Make technical trade-offs between short-term team needs and long-term business needs, with a focus on performance, cost, and reliability
- Collaborate with ALICE teams in Seattle and partner teams across Alexa and AGI on cross-cutting infrastructure programs
- Drive operational excellence for Tier-1 production services, including on-call ownership, incident response, and continuous improvement
- Influence the broader ALICE software architecture and contribute to org-wide technical strategy
A day in the life
As the Senior SDE, you will be the technical lead for the India team, owning architecture decisions for LLMI components and contributing to ALICE's broader portfolio of infrastructure optimization products.
AI Resume Tailoring
Generate a resume tailored to this job's requirements based on your uploaded resume.
Compensation
AI Est. Total Comp
$93,000