Local LLMs with llamafile
About this Course
In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examplesCreated by: Duke University
Related Online Courses
In this course students will explore supervised machine learning techniques using the python scikit learn (sklearn) toolkit and real-world athletic data to understand both machine learning... more
This course helps you recognize the need to implement business process automation in your organization. You learn about automation patterns and use cases, and how to use AppSheet constructs to... more
This course is designed for high school students preparing to take the AP* Physics 1 Exam. * AP Physics 1 is a registered trademark of the College Board, which was not involved in the production... more
Charitable giving is rebounding as the economy improves. Yet there is a shortage of qualified fundraising professionals to help organizations connect their needs with potential donors. Through four... more
This specialization is intended for technical engineers, architects, and administrators using Google Cloud Platform (GCP), Kubernetes, and Istio to create, integrate, or modernize solutions. You... more
Powered by
