AI>In The News

Raspberry Pi's new AI HAT adds 8GB of RAM for local LLMs

CommunityNews

CommunityNews

Raspberry Pi's new AI HAT adds 8GB of RAM for local LLMs

Today Raspberry Pi launched their new $130 AI HAT+ 2 which includes a Hailo 10H and 8 GB of LPDDR4X RAM.
With that, the Hailo 10H is capable of running LLMs entirely standalone, freeing the Pi’s CPU and system RAM for other tasks. The chip runs at a maximum of 3W, with 40 TOPS of INT8 NPU inference performance in addition to the equivalent 26 TOPS INT4 machine vision performance on the earlier AI HAT with Hailo 8.

Read in full here:

View thread on forum
#raspberry#llms
0 2 0

Where Next?

View thread on forum
raspberry
llms
Home AI>In The News
#raspberry#llms
0 2 0
Last post

Popular Ai topics Top

AstonJ
AI>In The News

One of biology's biggest mysteries 'largely solved' by AI
Well done DeepMind… wonder what else they’re working on… One of biology’s biggest mysteries has been solved using artificial intelligen...
bbc.co.uk
#ai#covid19#deepmind
1 1562 1
New
First poster: CommunityNews
AI>In The News

Google AI tool can help patients identify skin conditions
Google has unveiled a tool that uses artificial intelligence to help spot skin, hair and nail conditions, based on images uploaded by pat...
bbc.co.uk
#google
0 1339 0
New
First poster: bot
AI>In The News

DeepMind AI rivals average human competitive coder
bbc.co.uk
#deepmind
2 942 0
New
First poster: CommunityNews
AI>In The News

In New Math Proofs, Artificial Intelligence Plays to Win
A new computer program fashioned after artificial intelligence systems like AlphaGo has solved several open problems in combinatorics and...
quantamagazine.org
#math
0 1287 0
New
First poster: AstonJ
AI>In The News

Why AI is still dumb and not scary at all (pt.1)
How I Learned to Stop Worrying and Love the AI
tejo.substack.com
15 722 9
New
First poster: alvinkatojr
AI>In The News

Mind-reading AI recreates what you're looking at with amazing accuracy
Giving AI systems the ability to focus on particular brain regions can make them much better at reconstructing images of what a monkey is...
newscientist.com
2 687 1
New
First poster: jaeyson
AI>In The News

Adobe to automatically move subscribers to pricier, AI-focused tier in June
Monthly fees for multi-app subscribers to rise by up to 16.7 percent.
arstechnica.com
#adobe
6 893 5
New
First poster: happyrat1
AI>In The News

AI could already be conscious. Are we ready for it?
With a leap in the evolution of large language models, some leading thinkers are questioning whether AI might become sentient
bbc.com
6 831 7
New
First poster: conradwt
AI>In The News

Switching to Claude Code + VSCode inside Docker
Why I decided to ditch Cursor and switch to running Claude Code in an isolated environment + diy guide!
timsh.org
#docker#code/vscode#claude
0 849 2
New
CommunityNews
AI>In The News

Impeccable: Design skills for AI coding tools
1 skill, 17 commands, and curated anti-patterns for impeccable frontend design. Works with Cursor, Claude Code, Gemini CLI, and Codex CLI...
impeccable.style
#coding#design
0 1 0
New

Other popular topics Top

siddhant3030
General Dev>Dev Chat

Which vertical monitor do you use?
I’m thinking of buying a monitor that I can rotate to use as a vertical monitor? Also, I want to know if someone is using it for program...
#monitors#programming
51 4892 20
New
AstonJ
General Dev>Hardware

Poll: Which keyboard layout do you use?
poll poll Be sure to check out @Dusty’s article posted here: An Introduction to Alternative Keyboard Layouts It’s one of the best write-...
colemakmods.github.io
#polls/keyboards
10 6048 11
New
PragmaticBookshelf
Android>Learning Resources

Kotlin and Android Development featuring Jetpack: Build Better, Safer Android Apps
Start building native Android apps the modern way in Kotlin with Jetpack's expansive set of tools, libraries, and best practices. Learn h...
pragprog.com
#pragprog#android#game-dev/kotlin#published-book/book-kotlin-and-android-development-featuring-jetpack
7 5084 1
New
PragmaticBookshelf
Backend>Learning Resources

Concurrent Data Processing in Elixir
Learn different ways of writing concurrent code in Elixir and increase your application's performance, without sacrificing scalability or...
pragprog.com
#pragprog/elixir#published-book/book-concurrent-data-processing-in-elixir
78 6059 24
New
husaindevelop
Android>Questions

Clipboard readtext not working in android webview
Inside our android webview app, we are trying to paste the copied content from another app eg (notes) using navigator.clipboard.readtext ...
#android#clipboard
1 5651 0
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Bruce Tate (Author) Interview and AMA!
Author Spotlight: Bruce Tate @redrapids Programming languages always emerge out of need, and if that’s not always true, they’re defin...
/elixir/ruby/phoenix/book-seven-more-languages-in-seven-weeks/book-seven-languages-in-seven-weeks#liveview/book-programming-phoenix-liveview
54 5678 23
New
PragmaticBookshelf
Backend>Learning Resources

Machine Learning in Elixir
Leverage Elixir and the Nx ecosystem to build intelligent applications that solve real-world problems in computer vision, natural languag...
pragprog.com
#pragprog/elixir#published-book#machine-learning#nx/book-machine-learning-in-elixir
18 4615 7
New
First poster: AstonJ
General Dev>In The News

Jan: An open source alternative to ChatGPT that runs on the desktop
Jan | Rethink the Computer. Jan turns your computer into an AI machine by running LLMs locally on your computer. It’s a privacy-focus, l...
jan.ai
#desktop#chatgpt
4 5652 4
New
AstonJ
Backend>Questions

Psql: error: connection to server on socket "/tmp/.s.PGSQL.5432" failed: No such file or directory
If you’re getting errors like this: psql: error: connection to server on socket “/tmp/.s.PGSQL.5432” failed: No such file or directory ...
#macos/rails/postgresql
1 5553 1
New
PragmaticBookshelf
Backend>Learning Resources

Kotlin Coroutine Confidence
Escape callback hell and ship fast, clean code that reads as smoothly as it runs. Squash bugs and stamp out memory leaks with an intuitiv...
pragprog.com
#pragprog/java/kotlin#published-book/book-kotlin-coroutine-confidence
14 3688 10
New
Back to top

Sponsor Spotlight

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

AI>In The News

AI In The News ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap