Engineering Manager, Model Deployment

Full Time
London, UK
7 months ago

At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, maternity or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.

 

Snapshot

We are seeking an experienced Engineering Manager to lead a team of engineers and researchers focused on optimizing the deployment of large AI models across Alphabet. You will play a crucial role in streamlining the research-to-production pipeline, and ultimately accelerating the delivery of cutting-edge AI deployments. This role requires expertise in developing and leading experts in LLM architecture, serving infrastructure, and production-level C++ development, as well as a passion for building and leading high-performing teams. As the team's engineering lead, you will play a vital role in maximizing the team's overall impact.

About Us

Artificial Intelligence could be one of humanity’s most useful inventions. At DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The Role

As an Engineering Manager in the Research Deployment space, you will lead a team of talented software and research engineers in tackling the complex challenges of deploying large language models (LLMs) at scale. Your team will be responsible for optimizing the entire LLM deployment lifecycle, ensuring both efficiency and quality. This includes collaborating with research teams to ensure models are production-ready, working with infrastructure teams to optimize the serving environment, and developing strategies to streamline the release process of cutting-edge work.

You will work in close partnership with Technical Leads who provide technical direction and ensure alignment with broader LLM development goals.

This role is crucial for accelerating the delivery of cutting-edge AI. You will have the opportunity to shape the future of AI at Alphabet by driving innovation in research deployment, ultimately impacting users at the Alphabet scale across a diverse range of applications.

Key responsibilities:
  • Lead and manage a team of engineers and researchers: Foster a collaborative and high-performing environment, providing mentorship and guidance to team members. Actively invest in their professional development through regular feedback, coaching, and opportunities for growth.
  • Work closely with Technical Leads: Collaborate on technical direction setting and ensure alignment with overall deployment strategy. Provide input based on your domain knowledge and experience.
  • Drive technical excellence in LLM deployment: Oversee the development and implementation of strategies for optimizing model implementation and serving infrastructure. Leverage your domain expertise to guide technical decisions and ensure best practices are followed.
  • Collaborate with key stakeholders: Partner with research teams, infrastructure teams, and product teams to ensure seamless integration and alignment with broader LLM development goals.
  • Track and measure progress: Define and monitor key performance metrics to assess the effectiveness of LLM deployment strategies and identify areas for improvement.
  • Champion a culture of collaboration and innovation: Encourage experimentation and creative problem-solving within the team.
  • Stay abreast of industry trends: Continuously evaluate emerging technologies and best practices to maintain a competitive edge.

You will have a chance to make a significant impact on the Google DeepMind mission by identifying, and building transformative solutions for fundamental engineering challenges. You will provide team and thought leadership, influencing our long-term engineering direction and contributing through a range of high impact initiatives in a critical strategic space for Alphabet.

About You

The role will suit candidates who enjoy working with state-of-the-art AI in a fast-moving and dynamic space, and have a passion for collaborative problem domains. You should exhibit exceptional creativity when approaching difficult or ambiguous problems, distilling big-picture challenges into tractable projects for your engineers and elevating others to succeed.

In order to set you up for success as a Software Engineer at DeepMind,  we look for the following skills and experience:

  • A degree in computer science, AI or equivalent experience.
  • Experience of managing small to mid-sized teams (between 5 and 10 Software Engineers and/or Research Engineers), including a proven ability to optimize for efficiency and effectiveness.
  • Experience in working with machine learning or high performance computing at scale.
  • Experience working with researchers and engineers working in research domains.
  • Experience with deployment in production environments.
  • Experience and comfort working in and leading within a highly collaborative and interdisciplinary environment.
  • Experience leading a team that collaborates across time zones, primarily between California and the U.K.

In addition, the following would be an advantage: 

  • Deep understanding of LLM technologies and the challenges associated with their deployment.
  • Knowledge of machine learning and/or statistics.
  • Experience in rapid deployment environments, especially to customers at scale.
  • Coaching and mentoring qualifications / experience.
  • Project management qualifications / experience.

Please include a cover letter when applying and tell us how you can make a difference to our team.

Application deadline: 5pm BST, Friday 3rd May 2024