Evaluating Large Language Model Outputs: A Practical Guide
About this Course
This course addresses evaluating Large Language Models (LLMs), starting with foundational evaluation methods, exploring advanced techniques with Vertex AI\'s tools like Automatic Metrics and AutoSxS, and forecasting the evolution of generative AI evaluation. This course is ideal for AI Product Managers looking to optimize LLM applications, Data Scientists interested in advanced AI model evaluation techniques, AI Ethicists and Policy Makers focused on responsible AI deployment, and Academic Researchers studying the impact of generative AI across various domains. A basic understanding of artificial intelligence, machine learning concepts, and familiarity with natural language processing (NLP) is recommended. Prior experience with Google Cloud Vertex AI is beneficial but not required. It covers practical applications, integrating human judgment with automatic methods, and prepares learners for future trends in AI evaluation across various media, including text, images, and audio. This comprehensive approach ensures you are equipped to assess LLMs effectively, enhancing business strategies and innovation.Created by: Coursera Instructor Network

Related Online Courses
In this 1.5 hour guided project, you will learn how to use one of the most versatile Linux networking utilities tcpdump to capture and analyze TCP traffic. Popular among all ranks of networking and... more
In this course, you will embark on a journey to master unit testing using Mockito and Spring Boot. Starting with an introduction to Mockito, you\'ll learn how to set up your projects using Spring... more
In the previous two courses, you have learned how to value startups using the discounted cash flow method and multiple methods. However, you have not learned how to estimate cash flows or earnings... more
In this 1-hour long project-based course, we will learn to create an IoT hub in the Azure cloud, register an IoT device within that IoT hub, send telemetry data from a raspberry pi web simulator to... more
Volunteer community health workers (CHWs) are a major strategy for increasing access to and coverage of basic health interventions. Our village health worker training course reviews the process of... more