
AstonJ
DeepSeek (671B) running on a cluster of 8 Mac Mini Pros with 64GB RAM each
This is cool!
DEEPSEEK-V3 ON M4 MAC: BLAZING FAST INFERENCE ON APPLE SILICON
We just witnessed something incredible: the largest open-source language model flexing its muscles on Apple Silicon. We’re talking about the massive DeepSeek-V3 on M4 Mac, specifically the 671 billion parameter model running on a cluster of 8 M4 Pro Mac Minis with 64GB of RAM each – that’s a whopping 512GB of combined memory!
This isn’t just about bragging rights. It opens up new possibilities for researchers, developers, and anyone interested in pushing the boundaries of AI. Let’s dive into the details and see why DeepSeek-V3 on M4 Mac is such a big deal.
TABLE OF CONTENTS
- The Results Are In: DeepSeek V3 671B Performance on the M4 Mac Mini Cluster
- Why So Fast? Understanding the DeepSeek-V3 on M4 Mac Performance Advantage
- Exploring Key Considerations: Power, Cost, and Alternative Setups for Running DeepSeek-V3
- Conclusion: The Future of LLM Inference on Apple Silicon with DeepSeek-V3 on M4 Mac
Popular Ai topics

2020 has seen a significant uptick in the number of companies looking at adding Digital Wallets and tokenization to their offerings. On o...
New
New

Bitcoin uses more electricity annually than the whole of Argentina, analysis by Cambridge University suggests.
“Mining” for the cryptocu...
New

Digital currency Bitcoin has risen to a new record high of more than $50,000 (£36,000).
The so-called cryptocurrency, which was created ...
New

As much as $365 billion wiped off cryptocurrency market after Tesla stops car purchases with bitcoin.
Tesla CEO Elon Musk said Tesla wou...
New

How Blockchains Work
Chances are, you know what Bitcoin is. After all, it’s valued at over $47,000 per Bitcoin right now. This post isn’t...
New

El Salvador has become the first country in the world to officially classify Bitcoin as legal currency.
Congress approved President Nayi...
New
New

Bitcoin mines require a lot of energy to power the computers inside. Greenidge Generation in New York has converted a former coal plant i...
New

Blockchain technology is set to play a transformative role in the future of online casino game development. By offering enhanced transpar...
New
Other popular topics

Hello Devtalk World!
Please let us know a little about who you are and where you’re from :nerd_face:
New

I am thinking in building or buy a desktop computer for programing, both professionally and on my free time, and my choice of OS is Linux...
New
New

A Hero’s Journey
with Chris Pine
@chrispine
Chris Pine, author of Learn to Program, Third Edition, discusses his journey to beco...
New

Here’s the story how one of the world’s first production deployments of LiveView came to be - and how trying to improve it almost caused ...
New

We’ve talked about his book briefly here but it is quickly becoming obsolete - so he’s decided to create a series of 7 podcasts, the firs...
New

Build efficient applications that exploit the unique benefits of a pure functional language, learning from an engineer who uses Haskell t...
New

Author Spotlight
Mike Riley
@mriley
This month, we turn the spotlight on Mike Riley, author of Portable Python Projects. Mike’s book ...
New
New

Author Spotlight:
Sophie DeBenedetto
@SophieDeBenedetto
The days of the traditional request-response web application are long gone, b...
New
Latest in AI
Latest (all)
Categories:
Popular Portals
- /elixir
- /opensuse
- /rust
- /kotlin
- /ruby
- /erlang
- /python
- /clojure
- /react
- /quarkus
- /go
- /react-native
- /vapor
- /v
- /wasm
- /django
- /security
- /nodejs
- /centos
- /rails
- /haskell
- /fable
- /gleam
- /swift
- /deno
- /js
- /tailwind
- /assemblyscript
- /laravel
- /symfony
- /phoenix
- /crystal
- /typescript
- /debian
- /adonisjs
- /julia
- /arch-linux
- /svelte
- /spring
- /c-plus-plus
- /preact
- /flutter
- /actix
- /java
- /angular
- /ocaml
- /zig
- /kubuntu
- /scala
- /zotonic
- /vim
- /rocky
- /lisp
- /html
- /keyboards
- /emacs
- /vuejs
- /nim
- /elm
- /nerves