At FriendliAI, we empower innovation by providing the best inference serving engine for generative AI. Our mission is to enable our customers to serve their generative AI models efficiently, with low costs and minimal environmental impact.

Responsibilities

As a cloud backend software engineer, you will play a crucial role in building and operating products and infrastructure for serving generative AI at scale.

• Build and operate scalable and reliable services that run on GPUs across geographic regions and cloud providers
• Build products that operate on Docker and Kubernetes
• Build products and infrastructure at the intersection of distributed systems and machine learning
• Build tools to operate services for reliability and scalability

Qualifications

• BS (or higher) in Computer Science or a related field
• 5+ years of production-level experience in Python and C++.
• Experience developing large-scale distributed systems.
• Experience with Docker, Kubernetes, and Terraform.
• Experience with public cloud technologies, e.g. AWS, Azure, GCP.
• Experience working on a PaaS/SaaS platform or with Service-Oriented Architectures.
• Experience with security and systems that handle sensitive data.