Local LLMs with llamafile
About this Course
In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examplesCreated by: Duke University
Related Online Courses
This specialization is primarily aimed at first- and second-year undergraduates interested in psychology, data analysis, ethics in research, and quantitative research methods along with high school... more
Do you know that research shows that progressive web apps can increase user engagement by 180%? In this 1.5-hour long project-based course, you will learn the basics of creating a progressive web... more
This course covers BigQuery fundamentals for professionals who are familiar with SQL-based cloud data warehouses in Snowflake and want to begin working in BigQuery. Through interactive lecture... more
AWS: Databases Course is the second course of Exam Prep (DEA-C01): AWS Certified Data Engineer - Associate Specialization. This course assists learners in designing relational and non-relational... more
Prepare to transition to college using intentional decision-making. Aimed at active duty service members and veterans, with this course you will learn about the college admission process, including... more
Powered by
