ManningBooks

ManningBooks

Devtalk Sponsor

Build Applications with Local AI Models on a Mac (Manning)

Build Applications with Local AI Models on a Mac shows you exactly how to build and run a ChatGPT-style assistant entirely on your own Mac—free forever, with zero data leaving your machine. In this practical book, AI authority Keiji Kamigusa guides you step by step using readily available open source models, Ollama, Python, and Streamlit.

Keiji Kamigusa

If you’ve been curious about running AI locally instead of depending on cloud APIs, this book walks you through building a ChatGPT-style assistant that runs on your own Mac. The focus is practical: install the tools, download open models, write the app, test it offline, and keep improving it.

The book is written for readers who are comfortable using a computer but may be new to programming. It starts with the Terminal, Homebrew, and Ollama, then moves into Python, Streamlit, voice input, chat history, model selection, RAG, and agents.

A few things you’ll build and try along the way:

  • Run Llama, Gemma, Qwen, and Mistral locally with Ollama

  • Create a ChatGPT-like web app with Streamlit

  • Add streaming responses and conversation memory

  • Switch between models from the app UI

  • Use system prompts and temperature settings to shape model behavior

  • Test privacy by turning off the network and watching the app keep working

  • Add document-based question answering with RAG

  • Explore LangChain agents that can use tools

Keiji Kamigusa brings a lot of hands-on experience to the topic. He has worked in AI and machine learning for over 16 years, deployed local language models for more than 50 companies, taught over 42,000 students, and written more than 50 books on AI.

This should be especially useful if you want to experiment with AI apps without sending prompts or documents to a hosted service. It’s also a good fit for Mac users who want a clear path from “I’ve never used the command line much” to “I have a working local AI app.”


Don’t forget you can get 45% off with your Devtalk discount! Just use the coupon code “devtalk.com” at checkout :+1:

Most Liked

alvinkatojr

alvinkatojr

Most likely when the author started writing the book, gemma3:4b was available. He’ll probably test the code with the latest gemma model when he’s done and make adjustments.

Where Next?

Popular Ai topics Top

New
New
pragdave
Build robust LLM-powered apps, chatbots, and agents while mastering AI engineering principles that will help you outlast the tools and th...
New
pragdave
Build a prototype in a weekend or a full product in a month or two. Untangle legacy systems, improve tests and documentation, and tackle ...
New
ManningBooks
Dr Luca Belli, co-founder and former research lead for Twitter’s Machine Learning Ethics, Transparency and Accountability team, has been ...
New
ManningBooks
Rearchitecting LLMs: Structural techniques for efficient models turns research from the latest AI papers into production-ready practices ...
New
ManningBooks
LLM Customization and Fine-Tuning is a hands-on playbook for turning a general-purpose open-weights model into a focused, cost-efficient ...
New
ManningBooks
Until recently, writing GPU kernels for LLM training and inference meant learning low-level programming tools like CUDA and C++. Triton, ...
New
ManningBooks
The Claude suite of LLM-powered tools and agents from Anthropic has radiacally–and permanently–changed the way technical professionals de...
New
ManningBooks
It’s expensive and time consuming to change, tune, and retrain an LLM to modify an agent’s behavior. Self-Improving Agents: How to engine...
New

Other popular topics Top

Devtalk
Hello Devtalk World! Please let us know a little about who you are and where you’re from :nerd_face:
New
dasdom
No chair. I have a standing desk. This post was split into a dedicated thread from our thread about chairs :slight_smile:
New
brentjanderson
Bought the Moonlander mechanical keyboard. Cherry Brown MX switches. Arms and wrists have been hurting enough that it’s time I did someth...
New
AstonJ
Just done a fresh install of macOS Big Sur and on installing Erlang I am getting: asdf install erlang 23.1.2 Configure failed. checking ...
New
AstonJ
Continuing the discussion from Thinking about learning Crystal, let’s discuss - I was wondering which languages don’t GC - maybe we can c...
New
New
New
sir.laksmana_wenk
I’m able to do the “artistic” part of game-development; character designing/modeling, music, environment modeling, etc. However, I don’t...
New
PragmaticBookshelf
Get the comprehensive, insider information you need for Rails 8 with the new edition of this award-winning classic. Sam Ruby @rubys ...
New
PragmaticBookshelf
This book forgoes the abstract and instead provides concrete examples to help you better leverage the unique properties of Elixir, Erlang...
New