Inference Performance & Deployment - Member of Technical Staff

About the Role

Callosum believes that orders of magnitude improvements in AI systems will come through application-aware orchestration across heterogeneous hardware. We are building that vision: infrastructure that treats the full landscape of compute as a unified, co-evolving system, evolved beyond GPUs.

This role owns the bridge between Callosum's internal engineering and the real world. You design the tooling and methodologies that ground our technology in real-world performance and behaviour, sitting at the integration point of every engineering function. You will be the first to run our heterogeneous infrastructure in production-equivalent conditions, systematically characterising performance, identifying bottlenecks, and driving decisions on production-readiness. Your work ensures that every layer of the stack is guided by empirical evidence rather than assumption.

What You’ll Build

• Run experiments self-hosting models on cloud instances or on-prem across providers and hardware configurations, systematically characterising performance envelopes

• Develop and maintain deployment patterns that are reproducible, measurable, and optimised for latency, throughput, and cost

• Work at the orchestration and routing software that sits above the inference engine - to improve caching, request scheduling, batching, and resource allocation

• Act as the integration point for the other roles: consume new accelerator support, engine features, and infrastructure upgrades – to provide high-quality feedback on bottlenecks, essential capabilities, and guide the stack optimisations

• Build and maintain benchmarking harnesses, regression suites, and performance dashboards that give the team a shared view of system health and progress

What We Offer

• Competitive Salary, determined by skills and experience

• Equity & Ownership

• Private healthcare

• We offer Visa sponsorship and relocation benefits to hire the best in the world

• We work in person at our London office. You'll have the tools, space and setup to do your best work, and if you have specific needs, just tell us

We're committed to building an inclusive workplace where everyone feels welcome, and believe in equal opportunities for all.