Senior Security Engineer, Product & Platform

About the role

LiteLLM is an open-source AI Gateway that gives developers a unified interface to LLM providers. We’re looking for a Senior Security Engineer to secure our application, infrastructure, and software delivery pipeline.

About the role

This is a hands-on individual contributor role reporting to our security lead. You’ll work directly with engineers to review and harden LiteLLM’s Python codebase, secure releases, and make security part of how we build. San Francisco is preferred, but not required.

You’ll own your roadmap, implement improvements yourself, and make day-to-day decisions independently. You should be comfortable prioritizing competing risks and explaining the tradeoffs behind your decisions.

The ideal candidate has built and owned a product, platform, or infrastructure security program and knows how to turn security findings into lasting engineering improvements.

Responsibilities

• Review and harden LiteLLM’s Python codebase, fixing vulnerabilities and addressing their underlying causes.

• Review sensitive pull requests and architecture changes before they reach production.

• Harden our build and release pipeline, including GitHub Actions permissions, workload identity, signing, and credential handling.

• Build and maintain automated controls for secrets detection, credential management, and software release integrity.

• Review cloud architecture, IAM, secrets management, and workload identity, and implement security improvements.

• Build guardrails and secure defaults that fit how engineers work.

• Document our security architecture, decisions, and operating practices.

• Own delivery and ongoing maintenance of product and pipeline security improvements.

What we’re looking for

• 7+ years of relevant experience, including independent ownership of a security scope.

• Experience hardening a production CI/CD pipeline, including GitHub Actions permissions and keyless signing.

• Strong knowledge of a major cloud provider, preferably AWS, including IAM, secrets management, and workload identity.

• Familiarity with Terraform.

• Ability to read production Python web-service code, identify vulnerabilities, and implement fixes.

• Experience building security tooling and guardrails that engineering teams adopted.

• Strong judgment about prioritization and risk when several problems need attention at once.

• Excellent written and verbal communication, including the ability to coordinate across time zones independently.

Bonus points

• Experience as the first or second security hire at a developer-tools or open-source company.

• A background in software, platform, or infrastructure engineering.

• Experience leading platform or infrastructure security, defining roadmaps, and owning the security of releases.

Why join LiteLLM?

• Secure an open-source product, its infrastructure, and its software delivery pipeline.

• Work directly with engineers and influence how software gets designed and shipped.

• Set priorities and implement the improvements you recommend.

• Build security practices that become part of everyday engineering work.

About LiteLLM

LiteLLM provides a unified API for LLM providers, along with routing, authentication, budgets, observability, and governance for production AI systems.