Local LLMs with llamafile
About this Course
In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examplesCreated by: Duke University
Related Online Courses
Test Driven Development (TDD) is an industry accepted technique to build Enterprise Applications and enhance quality. This course will introduce a test first approach for the development of Java... more
Exam AZ-400: Microsoft Certified DevOps Engineer is an expert-level certification exam from Microsoft for those who are working as DevOps Experts, DevOps Support Professionals, and Cloud Engineers.... more
It seems anymore that you can\'t listen to the news without hearing of a data breach. You may have heard it said before that there are 2 types of companies out there, the ones who have been... more
In this comprehensive course, you will gain essential knowledge and practical skills in cybersecurity operations and analysis. You\'ll understand the importance of security practices, tools, and... more
Petroleum Engineering with AI Applications offers a comprehensive learning experience combining upstream and midstream operations with AI. The course covers the oil and gas field life cycle,... more
Powered by
