#googleaihackathon — Public Fediverse posts

Here is a write-up of our project submission for the #GoogleAIHackathon, task was to build a creative app using their #Gemini LLM. We built an LLM (Gemini) based evaluation framework for RAG (Retrieval Augmented Generation) systems optimized with example-driven prompts using #DSPy to generate scores from #RAGAS (-style) metrics. Shoutout to Dave Campbell and Mayank Bhaskar my co-contributors to the project for all their hard work! Links to video and GitHub in post -- https://sujitpal.blogspot.com/2024/05/finetuning-ragas-metrics-using-dspy.html