Staff Machine Learning Engineer, Agentic App Platform

The Role

Are you up for an exciting challenge? Picture yourself scaling and optimizing a cutting-edge Generative AI product that offers instant assistance to enterprise users. Ever wondered how to apply abstraction, scalability, and optimization to a dynamic, probabilistic, and generative conversational system? If so, we invite you to join our Conversation Engine team. At our company, you'll have the unique opportunity to work at the core of Moveworks Generative AI product. Your main focus will be scaling and optimizing it to meet the growing demands of the enterprise solution space. Take a look at our recent posts (Moveworks Live, Creator Studio) on Moveworks’s groundbreaking solutions for enterprise AI. As pioneers in enterprise AI, we don't follow a set formula for building the next solution. Instead, we encourage you to bring your innovative ideas and imagination to solve unsolved problems. You'll collaborate closely with machine learning experts and cross-functional teams, rapidly iterating over new ideas, and leveraging user behavior data to make informed decisions. Your challenge will be to scale and optimize our conversation engine to support hundreds of millions of users, across multiple chat channels and use cases, and enhance our end-to-end product infrastructure with the utmost engineering quality and robustness.

What you get to do in this role:

 

• Construct an extensive product infrastructure, complete with user-friendly interfaces that empower engineers and configurators to effortlessly customize and optimize generative AI models. This includes collecting data and feedback, adapting to diverse enterprise use cases and business contexts, and delivering domain-specific conversational experiences.
• Design scalable API abstractions for our conversation platform, which supports all popular chat clients (for example, MSTeams, Slack, and Web) and offers a neutral API for developing other parts of the engineering system.
• Optimize the dialog engine to accommodate a wide range of conversational features, leveraging private domain knowledge unique to each enterprise customer in the cloud, and enable real-time multilingual translation. You will achieve this with minimal memory footprint, low latency, and streamlined development process for application engineers.
• Champion the best practices for coding patterns, API design, scalability, robustness, and optimization. Foster a culture of excellence and continuous improvements among fellow engineers.
• Provide comprehensive insights and visibility into the performance of our conversational AI product. This involves implementing a robust logging and tracing framework, user-friendly debugging and triaging tools, and automated metrics for efficient monitoring and analysis.
• Collaborate closely with ML engineers, application engineers, product teams, and customer support teams to drive the development of new features and scalability initiatives.

To be successful in this role you have:

 

• A strong foundation in computer science and software engineering, coupled with expertise in building scalable systems.
• A deep understanding of clean, modular, and scalable API design. You have the ability to champion best coding practices and influence fellow engineers to uphold high standards of code quality and craftsmanship.
• A passion for optimizing systems and improving performance. You are well-versed in tracing, logging, and metrics frameworks, and possess a systematic approach to quickly identify and resolve latency bottlenecks, race conditions, and throughput limitations.
• The ability to independently research new requirements and develop innovative solutions. You thrive in an environment of fast-paced coding and execution, embracing rapid iterations to deliver results.
• Strong communication skills to effectively articulate rationales and design approaches. You have a cross-functional awareness that enables you to collaborate seamlessly with various teams.
• A bachelor's degree or higher in computer science or a related field, demonstrating your academic foundation in the field.
• 7+ years of professional development experience, specifically in building systems at scale.