DIY Gen AI: Running LLMs locally with LM Studio and Ollama

Ollama is a simple, command-line based tool to run LLMs locally and easily. It can download and serve many models and you can easily interact with it via Python, curl or other methods.

LM Studio is an easy to use desktop app for experimenting with local and open-source Large Language Models by hosting them on your own system.
Here are some of the features it provides (quoted from its homepage):

Run LLMs on your laptop, entirely offline
Use models through the in-app Chat UI or an OpenAI compatible local server
Download any compatible model files from HuggingFace repositories
Discover new & noteworthy LLMs in the app's home page

In this session, we'll demo and cover the basics of getting up and running with Ollama and LM Studio. We'll see how to run the application, pick models, setup chat interfaces, start a server that we can query with Python code, and more.

Join author, trainer and speaker Brent Laster to learn about how to easily run LLMs locally on your own systems using Ollama and LM Studio. We'll look at how to use the LLMs for Chat, programming interfaces with Python, and more!

About Brent Laster

Hi, I'm Brent Laster - a global trainer and book author, experienced corporate technology developer and leader, and founder and president of Tech Skills Transformations LLC. I've been working with and presenting at NFJS events for many years now and it is always exciting and interesting.

Through my decades in programming and management,I've always tried to make time to learn and develop both technical and leadership skills and share them with others Regardless of the topic or technology, my belief is that there is no substitute for the excitement and sense of potential that come from providing others with the knowledge they need to help them accomplish their goals.

In my spare time, I hang out with my wife Anne-Marie, 4 children and 2 small dogs in Cary, North Carolina where I design and conduct trainings and write books. You can find me on LinkedIn (linkedin.com/in/brentlaster), Twitter (@brentclaster) or through my company's website at www.getskillsnow.com.

More About Brent »