Local LLMs with llamafile
About this Course
In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examplesCreated by: Duke University
Related Online Courses
DevOps is more than just a fusion of development and operations. It is the cultural change that organizations everywhere are adopting to become more agile and innovate at scale. It makes it easier... more
This specialization is designed to teach learners beginning and intermediate concepts of statistical analysis using the Python programming language. Learners will learn where data come from, what... more
In this project, you will learn how to analyze data and identify trends using a variety of tools in Microsoft Excel. Conditional formatting and charts are two tools that focus on highlighting and... more
Where have you experienced biology today? Journey through the science of life through the lens of our daily lives. This specialization is intended to bridge the gap between traditional biology... more
This course provides information about attraction and relationships, broadly defined. Topics in the course include how people learn about each other, the mechanisms that underlying the initial... more
Powered by
