Backend>Blogs/Talks

Easy at-home AI with Bumblebee and Fly GPUs

brainlid

brainlid

Easy at-home AI with Bumblebee and Fly GPUs

A big barrier to getting started with local AI development is access to hardware. And by “local”, I mean having direct access to a GPU and not going through AI-as-a-Service. Some of us are lucky enough to have a beefy Nvidia GPU, if so, good for you. For the rest of us, we can use a GPU on Fly.io while editing the app on our machine. Sounds crazy? It’s actually really cool, and easy. Check out the ready-to-deploy server app with 3 LLMs setup for your immediate enjoyment.

View thread on forum
#ai/elixir#blog-post#development#llm
1 225 0

Where Next?

View thread on forum
elixir
ai
blog-post
development
llm
Home Backend>Blogs/Talks
#ai/elixir#blog-post#development#llm
1 225 0
Last post

Popular Backend topics Top

CommunityNews
Backend>Blogs/Talks

Optimization - Making Rust Code Go Brrrr
aspenuwu.me
/go/rust#code
2 1207 1
New
First poster: bot
Backend>Blogs/Talks

Introduction to Postgrest
Part 1: Introduction to Postgrest. In Codd, we trust In the field of Computer Science and Engineering, few things come close to the dura...
samkhawase.com
#postgres
11 1380 5
New
First poster: iPaul
Backend>Blogs/Talks

The Future of Clojure
thoughtworks.com
/clojure#podcasts
3 1460 2
New
First poster: bot
Backend>Blogs/Talks

Why Zig when there is already C++, D, and Rust?
Why Zig When There is Already C++, D, and Rust? No hidden control flow No hidden allocations First-class support for no standard library...
ziglang.org
/c-plus-plus/rust/zig
0 1427 0
New
AstonJ
Backend>Blogs/Talks

Ruby Creator Yukihiro Matsumoto talks about Ruby 3 (interview)
Not had time to read it yet but this looks like a good interview… Our friend Yukihiro Matsumoto, creator of the Ruby programming langua...
evrone.com
/ruby#interiew
1 1388 0
New
First poster: bot
Backend>Blogs/Talks

PHP in 2021
Once a year, I look back at the recent developments in the PHP world, and also look forward to what’s to come. And just like in 2020 and ...
stitcher.io
/php
0 1072 0
New
First poster: bot
Backend>Blogs/Talks

Julia is the better language for extending Python
Just a small test with lists in cython. Considering echosystem, multithreading and ease of use, Julia is a clear winner here.
github.com
/julia/python
0 1185 0
New
tonyxrandall
Backend>Blogs/Talks

Migrating From Python to Kotlin for Our Backend Services (DoorDash)
When DoorDash approached the limits of what our Django-based monolithic codebase could support, we needed to design a new stack that woul...
doordash.engineering
/kotlin/python#blog-post#backend
3 3182 0
New
chikega
Backend>Blogs/Talks

RustLatam 2019 - Kevin Hoffman: WebAssembly with Rust
Mark Hoffman, the author of Programming WebAssembly in Rust, is a pretty hilarious lecturer if you like a dry sense of humor.
youtu.be
/rust/book-programming-webassembly-with-rust
6 1130 1
New
mudasobwa
Backend>Blogs/Talks

Long-lived Process and State Recovery After Crashes
Peeper is the tiny library to preserve state across GenServer crashes/restarts. Works as an almost drop-in substitute for GenServer, sui...
rocket-science.ru
/elixir#blog-post#opensource
3 273 0
New

Other popular topics Top

AstonJ
General Dev>Hardware

Which keyboard do you have?
If it’s a mechanical keyboard, which switches do you have? Would you recommend it? Why? What will your next keyboard be? Pics always w...
#hardware/keyboards#sticky#mechanical-keyboards
144 8502 50
New
axelson
Cross Platform>Libraries/Tools

Obsidian – a cross platform app to help you create a knowledge base with Markdown files
I’ve been really enjoying obsidian.md: It is very snappy (even though it is based on Electron). I love that it is all local by defaul...
#apps#macos#windows#linux/markdown#obsidian
38 4062 19
New
siddhant3030
General Dev>Dev Chat

Which vertical monitor do you use?
I’m thinking of buying a monitor that I can rotate to use as a vertical monitor? Also, I want to know if someone is using it for program...
#monitors#programming
51 4319 20
New
AstonJ
General Dev>Code Editors

SpaceVim vs SpaceMacs
SpaceVim seems to be gaining in features and popularity and I just wondered how it compares with SpaceMacs in 2020 - anyone have any thou...
/vim#spacevim#spacemacs/emacs#code-editors
30 3579 14
New
First poster: bot
Backend>In The News

Bit – A modernized Git CLI written in Go
github.com
/go#git
1 5529 0
New
AstonJ
General Dev>Hardware

Custom keyboard keycaps
There’s a whole world of custom keycaps out there that I didn’t know existed! Check out all of our Keycaps threads here: https://forum....
#hardware/keyboards#keycaps#mechanical-keyboards
15 8183 19
New
Margaret
General Dev>Dev Chat

PragProg’s Medium Posts
Hello everyone! This thread is to tell you about what authors from The Pragmatic Bookshelf are writing on Medium.
#pragprog#blog-post
1143 25883 760
New
mafinar
Backend>Chat

Data Structures and Algorithms with Elixir
This is going to be a long an frequently posted thread. While talking to a friend of mine who has taken data structure and algorithm cou...
/elixir#algorithms#data-structures
108 9152 31
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Karl Stolley (Author) Interview and AMA!
Author Spotlight: Karl Stolley @karlstolley Logic! Rhetoric! Prag! Wow, what a combination. In this spotlight, we sit down with Karl ...
#author-spotlight/book-programming-webrtc
31 3800 16
New
Fl4m3Ph03n1x
AI>Questions

What are the best text-to-speech ai generation tools that you can run locally?
Background Lately I am in a quest to find a good quality TTS ai generation tool to run locally in order to create audio for some videos I...
#ai#text-to-speech
6 2684 3
New
Back to top

Sponsor Spotlight

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Latest in Elixir

Elixir Portal ❯

Backend>Blogs/Talks

Backend Blogs/Talks ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap