Job Description
Are you excited about building the systems that process and optimize AI inference requests at scale?
Do you want to work hands-on with cutting-edge AI serving technologies and large language models?
Join the Akamai Inference Cloud Team!
The Akamai Inference Cloud team develops AI platforms for inference models and applications within Akamai's Cloud Technology Group. The Inference Execution & Runtimes team manages the inference engine, AI runtime frameworks, model serving infrastructure, and execution environment. Their work impacts latency, throughput, and efficiency of AI workloads across Akamai's extensive global infrastructure.
Partner with the best
As a Senior Software Engineer on the Inference Execution & Runtimes team, contribute to prompt processing, tokenization, and request handling pipelines. Collaborate with experienced engineers to transform user requests into optimized model inputs. This role offers significant e...