Backend>Blogs/Talks

Easy at-home AI with Bumblebee and Fly GPUs

brainlid

brainlid

Easy at-home AI with Bumblebee and Fly GPUs

A big barrier to getting started with local AI development is access to hardware. And by “local”, I mean having direct access to a GPU and not going through AI-as-a-Service. Some of us are lucky enough to have a beefy Nvidia GPU, if so, good for you. For the rest of us, we can use a GPU on Fly.io while editing the app on our machine. Sounds crazy? It’s actually really cool, and easy. Check out the ready-to-deploy server app with 3 LLMs setup for your immediate enjoyment.

View thread on forum
#ai/elixir#blog-post#development#llm
1 363 0

Where Next?

View thread on forum
elixir
ai
blog-post
development
llm
Home Backend>Blogs/Talks
#ai/elixir#blog-post#development#llm
1 363 0
Last post

Popular Backend topics Top

First poster: bot
Backend>Blogs/Talks

Where (and how) you limit your concurrency in Go can matter
utcc.utoronto.ca
/go
0 1576 0
New
First poster: bot
Backend>Blogs/Talks

Haskell is a Bad Programming Language (2020)
Such inflammatory, much wow. Unfortunately, Haskell itself agrees. Some languages naturally lend themselves towards adoption. Some don’t...
blog.shitiomatic.tech
/haskell#programming
0 1782 0
New
First poster: bot
Backend>Blogs/Talks

Libp2p tutorial: Build a peer-to-peer app in Rust
Over the last few years, due in large part to the hype surrounding blockchain and cryptocurrencies, decentralized applications have gaine...
blog.logrocket.com
/rust
0 2248 0
New
First poster: bot
Backend>Blogs/Talks

Julia is the better language for extending Python
Just a small test with lists in cython. Considering echosystem, multithreading and ease of use, Julia is a clear winner here.
github.com
/julia/python
0 1445 0
New
First poster: OvermindDL1
Backend>Blogs/Talks

The Gleam Programming Language and its Creator Louis Pilfold
youtube.com
/gleam#programming
16 1819 4
New
CommunityNews
Backend>Blogs/Talks

A Firehose of Rust, for busy people who know some C++
This thread was posted by one of our members via one of our news source trackers.
youtube.com
/c-plus-plus/rust#video
5 1365 1
New
wolf4earth
Backend>Blogs/Talks

ElixirMix 140 - How to Become a Top End Developer
Charles Max Wood takes the lead this week. He and Adi Iyengar discuss what Top End Devs are and what people should be doing to become Top...
devchat.tv
/elixir#beam#podcasts#career
16 1981 5
New
axelson
Backend>Blogs/Talks

Hot Reloading: A Faster Way to Develop Modern Apps
I describe how we use Hot Reloading with Webpack to develop faster and show how to integrate Webpack 5, webpack-dev-server, and Phoenix f...
felt.com
/elixir#blog-post
9 1472 3
New
brainlid
Backend>Blogs/Talks

Safe Ecto Migrations - Recipes and Resources
There is a new community resource available on writing “Safe Ecto Migrations”. When we get a migration wrong, it can lock up your product...
fly.io
/elixir#blog-post#postgres#database
4 1417 0
New
brainlid
Backend>Blogs/Talks

Created my Personal AI Fitness Trainer in 2 Days
In a 2 day spike, I created my own Elixir-based AI Personal Fitness Trainer! The surprising part for me was how useful and helpful I foun...
fly.io
#ai/elixir#blog-post#fitness#chatgpt#workout
2 1120 0
New

Other popular topics Top

Devtalk
General Dev>Dev Chat

HELLO WORLD (Introductions thread!)
Hello Devtalk World! Please let us know a little about who you are and where you’re from :nerd_face:
#community
484 8259 119
New
PragmaticBookshelf
Data Science

Genetic Algorithms in Elixir
From finance to artificial intelligence, genetic algorithms are a powerful tool with a wide array of applications. But you don't need an ...
#pragprog#ai/elixir#published-book/book-genetic-algorithms-in-elixir
25 5243 6
New
AstonJ
Science/Tech>Health & Diet

David Sinclair's new Lifespan podcast
We’ve talked about his book briefly here but it is quickly becoming obsolete - so he’s decided to create a series of 7 podcasts, the firs...
#health#podcasts#bio-hackers#david-sinclair
87 6790 49
New
husaindevelop
Android>Questions

Clipboard readtext not working in android webview
Inside our android webview app, we are trying to paste the copied content from another app eg (notes) using navigator.clipboard.readtext ...
#android#clipboard
1 5651 0
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Peter Ullrich (Author) Interview and AMA!
Author Spotlight: Peter Ullrich @PJUllrich Data is at the core of every business, but it is useless if nobody can access and analyze ...
/elixir/phoenix/book-building-table-views-with-phoenix-liveview
72 4765 21
New
PragmaticBookshelf
Backend>Learning Resources

Ash Framework
Explore the power of Ash Framework by modeling and building the domain for a real-world web application. Rebecca Le @sevenseacat and ...
pragprog.com
#pragprog/elixir#published-book/ash/book-ash-framework
15 7555 9
New
Fl4m3Ph03n1x
AI>Questions

What are the best text-to-speech ai generation tools that you can run locally?
Background Lately I am in a quest to find a good quality TTS ai generation tool to run locally in order to create audio for some videos I...
#ai#text-to-speech
6 12337 3
New
pragdave
AI>Learning Resources

A Common-Sense Guide to AI Engineering
Build robust LLM-powered apps, chatbots, and agents while mastering AI engineering principles that will help you outlast the tools and th...
pragprog.com
#pragprog
17 1852 8
New
CommunityNews
Game Dev>In The News

Grand Theft Auto: Vice City | DOS games in browser
Open-source implementation of the classic GTA engine now running directly in your browser. Experience the reVC technology demo on DOS.Zon...
dos.zone
#games#browser
0 173 0
New
xiji2646-netizen
AI>Chat

Has anyone tried the Karpathy CLAUDE.md rules? (97.8k stars)
There’s a GitHub repo at forrestchang/andrej-karpathy-skills that’s sitting at 97.8k stars. It’s a single CLAUDE.md file with four behavi...
#claude
0 37 1
New
Back to top

Sponsor Spotlight

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Latest in Elixir

Elixir Portal ❯

Backend>Blogs/Talks

Backend Blogs/Talks ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap