1 sessions
- Chalk talkAI/MLKubernetesCross-Industry SolutionsGenerative AIOpen Source400 – ExpertData EngineerDevOps EngineerIT Professional / Technical ManagerMGM GrandAmazon Elastic Compute Cloud (Amazon EC2)Amazon Elastic Kubernetes Service (Amazon EKS)Amazon EC2 - Inf1Monday, Dec 025:00 p.m. Monday, Dec 02Unlock the full potential of large language model (LLM) inference on Amazon EKS using leading open source frameworks. Learn to construct highly scalable, GPU-accelerated clusters with Amazon EKS–optimized AMIs and NVIDIA CUDA runtimes. This chalk talk compares state-of-the-art open source inference engines with leading LLM frameworks. Explore performance metrics, auto scaling capabilities, NVIDIA GPU inference execution, and seamless integration with AWS services for maximum efficiency and scalability.
, Sr. WW Spec. SA, Containers, Amazon Web Services, In.c
, Sr. Specialist SA, Containers, Amazon Web Services
- Monday, Dec 25:30 PM - 6:30 PM PSTMGM Grand | Level 1 | Boulevard 167