Prompting Large Language Models (LLMs) with instructions performs impressively in many AI tasks such as intent detection and question answering over document sources. As Generative AI becomes widely adopted, small and medium-sized enterprises (SMEs) are increasingly turning to third-party services that allow them to prompt LLMs via a standard API to solve such AI tasks in business settings.
ΑΙ
Auditorium
Stavros Vassos
13:10 – 13:25
Cache me if you can: Efficient use of Large Language Models through Smart Caching