Select the right large language model for your application use case

There are a large number of large language models (LLMs) out there and choosing the right one is critical because of the high cost associated with deploying generative AI models. In this session, we share the key considerations when evaluating LLMs. Find out how to evaluate LLMs for tasks where the output is fact-based and when the output is creative by nature. With thousands of text generation models out there to choose from and endless prompt engineering possibilities to use them with, learn how you can quickly and reliably identify the best price-performance solution for your use case. We then explain how you can build a complete picture of model and prompt-template performance on AWS. The session also covers the use automated tools that work alongside human labellers to create scalable but accurate evaluations, enabling you to build high-quality solutions faster and deploy with confidence.

Speaker: Ben Friebe, Senior Solutions Architect, AWS