Local LLMs with llamafile
About this Course
In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examplesCreated by: Duke University
Related Online Courses
To promote the engineering skills required for Digital Factories, this proposed specialization on Intelligent Digital Factories offer the learners with strong fundamentals of the microcontrollers... more
In this guided project, we will build, train, and test a deep neural network model to classify low-resolution images containing airplanes, cars, birds, cats, ships, and trucks in Keras and... more
In the age of artificial intelligence (AI), it is essential to learn how to apply the power of large language models (LLMs) for building various production-ready applications. In this... more
In this 2 hour long project you will create a SCRUM project in Jira, exploring the SCRUM agile methodology and familiarizing with all of its elements. You will create user stories and tasks, plan... more
This course is ideal for those getting started in an IT career as an administrator/engineer who want to become a Linux Foundation Certified IT Associate (LFCA). The LCFA Exam Preparation course is... more
Powered by
