Senior Software Engineer - Dev Platform

The Team

Founded in 2011, Kraken is one of the world's longest-standing crypto platforms, trusted by over 10 million individuals and institutions across the globe. It offers spot trading, margin, futures, staking, and OTC services, with products built for both individual investors and institutional clients.

The Dev Platform team builds the internal platform that Kraken's engineers use to build, ship and run software. Within Dev Platform, the AI Gateway is Kraken's company-wide LLM gateway: a single, governed entry point that gives teams self-service access to leading models from providers such as Anthropic, OpenAI and Google, with visibility into usage and cost, configurable budgets and rate limits, and routing across models and providers for efficiency and resilience.

The Opportunity

• Build and extend the AI Gateway: new model and provider integrations, routing policies, budgets, rate limits, and usage and cost reporting

• Design the APIs, SDKs and self-service tooling that let engineers across Kraken onboard to the gateway quickly and safely

• Help teams migrate their LLM workloads onto the gateway with minimal disruption

• Implement access control, key management and audit logging in partnership with Security

• Instrument the gateway so teams can see latency, errors, token usage and cost for their own workloads

• Own features end to end, from design through production, and keep the service reliable alongside SRE

• Support internal users with clear documentation, debugging help and a tight feedback loop that shapes the roadmap

• Contribute to code review, design documents and engineering practices across Dev Platform

Skills You Should HODL

• Solid experience as a backend or platform software engineer building and operating APIs and distributed services in production

• Strong skills in a backend language such as Rust, Python or TypeScript, with a habit of writing well-tested, maintainable code

• Working knowledge of how LLM APIs behave: authentication, streaming responses, token accounting, rate limits and provider failure modes

• Experience with observability, CI/CD and containers, and comfort with Kubernetes and a major cloud provider

• Ability to design clean, well-documented APIs for internal customers and to weigh their feedback

• Clear written and verbal communication, and the ownership to carry work from idea to production

Nice to Haves

• Experience with API gateways, proxies or traffic management

• Experience building LLM-powered systems, including routing, caching, evaluation or cost controls

• Familiarity with authentication and authorization patterns (OAuth, OIDC, RBAC)

• Contributions to open-source infrastructure or developer-platform projects

Unless a specific application deadline is stated in the job posting, applications are accepted on an ongoing basis.

Please note, applicants are permitted to redact or remove information on their resume that identifies age, date of birth, or dates of attendance at or graduation from an educational institution.

We consider qualified applicants with criminal histories for employment on our team, assessing candidates in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance.