Local LLMs with llamafile
About this Course
In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examplesCreated by: Duke University

Related Online Courses
If you have fundamental proficiency in Mandarin Chinese, join us now to practice and improve your skill of the language spoken by more than 1 billion people. This may enable you to know and do... more
AWS: Storage Course is the first course of the Exam Prep (DEA-C01): AWS Certified Data Engineer - Associate Specialization. This course assists learners with knowledge of storage components with... more
The capstone will develop a higher-quality web portfolio. Students will demonstrate the ability to design and implement a responsive site for a minimum of three platforms. Adherence to validation... more
87% of Google Cloud certified users feel more confident in their cloud skills. This program provides the skills you need to advance your career and provides training to support your preparation for... more
This course takes you on a comprehensive journey from the basics of 3D modeling in Blender to importing a game-ready medieval windmill into Unreal Engine 5. Starting with a solid foundation in... more