General Dev>In The News

LoRA from scratch: implementation for LLM finetuning

CommunityNews

CommunityNews

LoRA from scratch: implementation for LLM finetuning

Code LoRA from Scratch - a Lightning Studio by sebastian.
LoRA (Low-Rank Adaptation) is a popular technique to finetune LLMs more efficiently.
This Studio explains how LoRA works by coding it from scratch, which is an excellent exercise for looking under the hood of an algorithm.

Read in full here:

This thread was posted by one of our members via one of our news source trackers.

View thread on forum
#llm
0 485 0

Where Next?

View thread on forum
llm
Home General Dev>In The News
#llm
0 485 0
Last post

Popular General Dev topics Top

wolf4earth
General Dev>In The News

Russia wants to ban the use of secure protocols such as TLS 1.3, DoH, DoT, ESNI
Quite scary if you ask me. And it seems China is already blocking TLS 1.3 traffic with their Great Firewall. On the other hand it’s a co...
#internet#encryption#censorship
1 971 1
New
Exadra37
General Dev>In The News

Call an Exorcist! My Robot’s Possessed! | McAfee Blogs
As part of our continued goal of helping developers provide safer products for businesses and consumers, we here at McAfee Advanced Threa...
mcafee.com
/security#api#tech-news-source
3 1623 1
New
First poster: bot
General Dev>In The News

SPWN – A programming language that compiles to Geometry Dash levels
SPWN is a programming language that compiles to Geometry Dash levels. What that means is that you can create levels by using not only the...
github.com
#programming
0 2217 0
New
First poster: cpgo
General Dev>In The News

8 Reasons to ditch Chrome and use Firefox
8 reasons to ditch Chrome and switch to Firefox. Chrome may dominate, but Firefox is a known name among browsers for a reason. Whether y...
pcworld.com
#chrome#firefox
73 1874 41
New
First poster: bot
General Dev>In The News

Matrix web-based green code rain, made with love
GitHub - Rezmason/matrix: matrix (web-based green code rain, made with love). matrix (web-based green code rain, made with love) - GitHu...
github.com
#green
1 657 0
New
CommunityNews
General Dev>In The News

Perplexica: Open-Source Perplexity Alternative
GitHub - ItzCrazyKns/Perplexica: Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI. Perplexic...
github.com
0 1794 0
New
First poster: alvinkatojr
General Dev>In The News

Yoke is really cool
Infrastructure as code, but actually
xeiaso.net
2 707 1
New
CommunityNews
General Dev>In The News

GitSyncPad - Effortless Git Version Control
GitSyncPad is an innovative micro keypad designed for effortless Git version control. Execute commands like git add, git commit, and git ...
gitsyncpad.xyz
#git
0 616 0
New
CommunityNews
General Dev>In The News

TrueSkill 2: An improved Bayesian skill rating system - Microsoft Research
Online multiplayer games, such as Gears of War and Halo, use skill-based matchmaking to give players fair and enjoyable matches. They dep...
microsoft.com
#microsoft
0 1031 0
New
First poster: andrea
General Dev>In The News

Everything I know about good API design
Most of what modern software engineers do involves APIs: public interfaces for communicating with a program, like this one from Twilio. I...
seangoedecke.com
#api#design
1 1534 1
New

Other popular topics Top

Devtalk
General Dev>Dev Chat

What dev-related stuff have you been up to?
Reading something? Working on something? Planning something? Changing jobs even!? If you’re up for sharing, please let us know what you’...
#community
1063 23582 394
New
PragmaticBookshelf
Backend>Learning Resources

Programming Machine Learning
Machine learning can be intimidating, with its reliance on math and algorithms that most programmers don't encounter in their regular wor...
pragprog.com
#pragprog#ai/python#published-book/book-programming-machine-learning#math#algorithms
6 5350 3
New
DevotionGeo
Backend>Chat

What is the reason behind Rust’s web framework, Rocket, not performing as well as expected in the Techempower benchmarks?
I know that these benchmarks might not be the exact picture of real-world scenario, but still I expect a Rust web framework performing a ...
#web-frameworks/rust
36 7463 11
New
Exadra37
Linux>Questions

AMD or Intel for Programming with Linux as the OS?
I am thinking in building or buy a desktop computer for programing, both professionally and on my free time, and my choice of OS is Linux...
#mobile#android#web-development#linux#desktop-computer#mobile-development
36 6006 10
New
AstonJ
General Dev>Hardware

Custom keyboard keycaps
There’s a whole world of custom keycaps out there that I didn’t know existed! Check out all of our Keycaps threads here: https://forum....
#hardware/keyboards#keycaps#mechanical-keyboards
15 11086 19
New
AstonJ
General Dev>Code Editors

Onivim 2 Code Editor
Thanks to @foxtrottwist’s and @Tomas’s posts in this thread: Poll: Which code editor do you use? I bought Onivim! :nerd_face: https://on...
#code-editors/onivim/revery
88 6144 32
New
Help
Game Dev>Questions

Can I use Java to program a game for Nintendo switch?
I am trying to crate a game for the Nintendo switch, I wanted to use Java as I am comfortable with that programming language. Can you use...
/java#nintendo
8 4771 3
New
PragmaticBookshelf
Backend>Learning Resources

Simplicity
Fight complexity and reclaim the original spirit of agility by learning to simplify how you develop software. The result: a more humane a...
pragprog.com
#pragprog#published-book/book-simplicity
10 6553 8
New
xiji2646-netizen
AI>Chat

Claude Code's entire source just leaked (512K lines) - anyone else digging through it?
Woke up to this today: Claude Code’s complete source code exposed via npm source map. Not a snippet. All 512,000 lines. 1,900 TypeScript ...
#claude
6 8359 5
New
CommunityNews
Android>In The News

It's official: EU will force Google to share search data and open up AI on Android
Google says these changes could endanger user privacy and security.
arstechnica.com
#android#google#data
0 2 0
New
Back to top

Sponsor Spotlight

Manning

Develop your skills with books, videos, and courses.

General Dev>In The News

General Dev In The News ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap