Speaker: Miloš Švaňa ProfIQ: www.profiq.cz Abstract: Many developers are enriching their apps with LLM functionality. But how to test LLM components properly? This task is generally more difficult than testing normal code because the output of LLM models is non-deterministic, API calls can be expensive, and getting a response takes a lot of time. In this talk, I am going to introduce several strategies for testing the LLM components of your application, each with different strengths and weaknesses. Some behave rather deterministically, others use an LLM to test an LLM. I’ll also talk about...