About Us

We’re LastMile AI, a company revolutionizing the way enterprises build, evaluate and deploy AI systems. Our flagship product, AutoEval, empowers organizations to fine-tune and assess AI models with unparalleled precision, scalability and ease. We are a small team, primarily comprised of experienced engineers and product designers.

Learn more here: Careers @LastMile AI

About the Role

We are seeking an exceptional engineer to be our head of infrastructure, who will build and manage our software platform, including building and leading a team around this function in the future. The role comprises challenging ML Ops problems to optimize our platform’s capabilities across various deployments with security, privacy and hardware constraints. Success in this position requires making decisions that anticipate the needs of customers and solving for challenges faced in real-world deployment scenarios.

Key Responsibilities

As the person in charge of LastMile AI's backend infrastructure, you would be responsible for:

• Guiding platform architecture to support known and anticipated deployment scenarios.
• Using Terraform to manage the infrastructure.
• Managing Kubernetes clusters and workers.
• Developing the inference and model training backend.
• Designing data pipelines including evaluation metric computations.
• Optimizing service reliability and performance for enterprise use-cases.
• Growing and mentoring the team as we scale.

Qualifications

• Exceptional infrastructure engineer (staff IC with 7+ years of experience) with prior first-hand experience building distributed systems at scale.
• Coding machine archetype.
• Entrepreneurial mindset with experience proactively identifying opportunities and tackling initiatives without waiting for direction.
• Based in or willing to relocate to New York.