Local LLMs with llamafile
About this Course
In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examplesCreated by: Duke University
Related Online Courses
By the end of this project, you will be fluent in identifying and creating Empathy Maps based on persona for new products and services and in deriving opportunities from your analysis, thus... more
The ultimate goal of a computer vision system is to generate a detailed symbolic description of each image shown. This course focuses on the all-important problem of perception. We first describe... more
This Specialization is intended for both current and new product managers working in digital who want to apply a portfolio of modern practices to developing their products and teams. Through five... more
The Advanced Network Security specialization is designed for Network Security Analysts, Information Technology (IT) Managers, or Cybersecurity Consultants to further their understanding of advanced... more
Hi again! This is the second course of the Google Cloud Data Analytics Certificate. Get cozy with the key components of data governance, normalized and star schemas, data catalogs, and data... more
Powered by
