ManningBooks

ManningBooks

Devtalk Sponsor

Build Applications with Local AI Models on a Mac (Manning)

Build Applications with Local AI Models on a Mac shows you exactly how to build and run a ChatGPT-style assistant entirely on your own Mac—free forever, with zero data leaving your machine. In this practical book, AI authority Keiji Kamigusa guides you step by step using readily available open source models, Ollama, Python, and Streamlit.

Keiji Kamigusa

If you’ve been curious about running AI locally instead of depending on cloud APIs, this book walks you through building a ChatGPT-style assistant that runs on your own Mac. The focus is practical: install the tools, download open models, write the app, test it offline, and keep improving it.

The book is written for readers who are comfortable using a computer but may be new to programming. It starts with the Terminal, Homebrew, and Ollama, then moves into Python, Streamlit, voice input, chat history, model selection, RAG, and agents.

A few things you’ll build and try along the way:

  • Run Llama, Gemma, Qwen, and Mistral locally with Ollama

  • Create a ChatGPT-like web app with Streamlit

  • Add streaming responses and conversation memory

  • Switch between models from the app UI

  • Use system prompts and temperature settings to shape model behavior

  • Test privacy by turning off the network and watching the app keep working

  • Add document-based question answering with RAG

  • Explore LangChain agents that can use tools

Keiji Kamigusa brings a lot of hands-on experience to the topic. He has worked in AI and machine learning for over 16 years, deployed local language models for more than 50 companies, taught over 42,000 students, and written more than 50 books on AI.

This should be especially useful if you want to experiment with AI apps without sending prompts or documents to a hosted service. It’s also a good fit for Mac users who want a clear path from “I’ve never used the command line much” to “I have a working local AI app.”


Don’t forget you can get 45% off with your Devtalk discount! Just use the coupon code “devtalk.com” at checkout :+1:

Most Liked

alvinkatojr

alvinkatojr

Most likely when the author started writing the book, gemma3:4b was available. He’ll probably test the code with the latest gemma model when he’s done and make adjustments.

Where Next?

Popular Ai topics Top

ManningBooks
Before deploying an AI model into production, you need to know more than just its accuracy. Will it be fast enough for your users? Will i...
New
ManningBooks
In Build a Reasoning Model (From Scratch), acclaimed ML research engineer Sebastian Raschka takes you inside the black box of reasoning-e...
New
ManningBooks
Grokking AI Algorithms, Second Edition introduces the most important AI algorithms using relatable illustrations, interesting examples, a...
New
ManningBooks
Rearchitecting LLMs: Structural techniques for efficient models turns research from the latest AI papers into production-ready practices ...
New
ManningBooks
Hugging Face in Action reveals how to get the absolute best out of everything Hugging Face, from accessing state-of-the-art models to bui...
New
ManningBooks
CUDA for Deep Learning shows you how to work within the CUDA ecosystem, from your first kernel to implementing advanced LLM features like...
New
ManningBooks
Introduction to Generative AI, Second Edition, guides you from your first eye-opening interaction with tools like ChatGPT to how AI tools...
New
ManningBooks
AI is changing how offensive security workflows are designed, executed, and analyzed. AI Agents for Offensive Security: AI-powered attack...
New
ManningBooks
Context engineering is the discipline of selecting, organizing, updating, compressing, prioritizing the precise context a model needs to ...
New
ManningBooks
Build Applications with Local AI Models on a Mac shows you exactly how to build and run a ChatGPT-style assistant entirely on your own Ma...
New

Other popular topics Top

Devtalk
Reading something? Working on something? Planning something? Changing jobs even!? If you’re up for sharing, please let us know what you’...
1063 23050 405
New
AstonJ
poll poll Be sure to check out @Dusty’s article posted here: An Introduction to Alternative Keyboard Layouts It’s one of the best write-...
New
AstonJ
We have a thread about the keyboards we have, but what about nice keyboards we come across that we want? If you have seen any that look n...
New
dimitarvp
Small essay with thoughts on macOS vs. Linux: I know @Exadra37 is just waiting around the corner to scream at me “I TOLD YOU SO!!!” but I...
New
PragmaticBookshelf
Use WebRTC to build web applications that stream media and data in real time directly from one user to another, all in the browser. ...
New
PragmaticBookshelf
Author Spotlight Rebecca Skinner @RebeccaSkinner Welcome to our latest author spotlight, where we sit down with Rebecca Skinner, auth...
New
PragmaticBookshelf
Programming Ruby is the most complete book on Ruby, covering both the language itself and the standard library as well as commonly used t...
New
hilfordjames
There appears to have been an update that has changed the terminology for what has previously been known as the Taskbar Overflow - this h...
New
AstonJ
If you’re getting errors like this: psql: error: connection to server on socket “/tmp/.s.PGSQL.5432” failed: No such file or directory ...
New
NewsBot
Node.js v22.14.0 has been released. Link: Release 2025-02-11, Version 22.14.0 'Jod' (LTS), @aduh95 · nodejs/node · GitHub
New