General Dev>In The News

Let's build GPT: from scratch, in code, spelled out by Andrej Karpathy [video]

CommunityNews

CommunityNews

Let's build GPT: from scratch, in code, spelled out by Andrej Karpathy [video]

Let’s build GPT: from scratch, in code, spelled out…
We build a Generatively Pretrained Transformer (GPT), following the paper “Attention is All You Need” and OpenAI’s GPT-2 / GPT-3. We talk about connections t…

Read in full here:

This thread was posted by one of our members via one of our news source trackers.

2 comments
#video#code
4 1337 2

Most Liked

mikhailgrib

mikhailgrib

Why I quit python 2 years ago

1
Post #3
DevotionGeo

DevotionGeo

Andrej is a genius!

1
Post #4

Where Next?

View thread on forum
video
code
Home General Dev>In The News
#video#code
4 1337 2
Last post

Popular General Dev topics Top

First poster: bot
General Dev>In The News

SPWN – A programming language that compiles to Geometry Dash levels
SPWN is a programming language that compiles to Geometry Dash levels. What that means is that you can create levels by using not only the...
github.com
#programming
0 2217 0
New
First poster: dyowee
General Dev>In The News

There’s No Such Thing as Clean Code
Everyone seems to be striving for ‘clean’ code at the moment. You can’t read a blog post without the author telling you how clean their a...
steveonstuff.com
#code
31 1701 9
New
First poster: bot
General Dev>In The News

Matrix web-based green code rain, made with love
GitHub - Rezmason/matrix: matrix (web-based green code rain, made with love). matrix (web-based green code rain, made with love) - GitHu...
github.com
#green
1 657 0
New
First poster: bot
General Dev>In The News

Apache Apisix vs. Kong: Open-Source API Gateway
API Gateway Trends behind Features: Apache APISIX 3.0 vs. Kong 3.0 - API7.ai. By comparing the open-source API Gateway Apache APISIX and...
api7.ai
#api
0 3596 0
New
First poster: bot
General Dev>In The News

Introducing the ChatGPT/LLM error tracker
Large Language Models like ChatGPT say The Darnedest Things. The Errors They MakeWhy We Need to Document Them, and What We Have Decided ...
garymarcus.substack.com
#error#chatgpt
0 3521 0
New
First poster: bot
General Dev>In The News

Tim Cook to take 50% pay hit after shareholder feedback
Apple’s Tim Cook to take 50% pay hit after shareholder feedback. ‘Target compensation’ for CEO down from $99.4m in 2022 to an expected $...
theguardian.com
#feedback
0 1856 0
New
CommunityNews
General Dev>In The News

Fintech engineering mistakes
9 fintech engineering mistakes. Read this list unless you want to build a money dissappearing system
startupwin.kelsus.com
0 1776 0
New
First poster: dyowee
General Dev>In The News

Go Package for Building Progressive Web Apps
A Go package for building Progressive Web Apps. A package for building progressive web apps (PWA) with the Go programming language (Gola...
go-app.dev
#apps/go#web/wasm
2 1283 1
New
First poster: DevotionGeo
General Dev>In The News

To avoid being replaced by LLMs, do what they can't
To avoid being replaced by LLMs, do what they can’t. What LLM’s can’t do yet
seangoedecke.com
18 1109 7
New
First poster: AstonJ
General Dev>In The News

Ladybird: Truly independent web browser
Truly independent web browser. Contribute to LadybirdBrowser/ladybird development by creating an account on GitHub.
github.com
#browser#web#github
4 988 3
New

Other popular topics Top

PragmaticBookshelf
Game Dev>Learning Resources

The Ray Tracer Challenge
Brace yourself for a fun challenge: build a photorealistic 3D renderer from scratch! In just a couple of weeks, build a ray tracer that r...
pragprog.com
#pragprog#published-book/book-the-ray-tracer-challenge#algorithms
3 14528 0
New
Exadra37
Linux>Questions

What is the most minimalist Linux server distro?
I am asking for any distro that only has the bare-bones to be able to get a shell in the server and then just install the packages as we ...
#linux#servers
66 25846 24
New
foxtrottwist
General Dev>Dev Chat

Warp—The blazingly fast, Rust-based terminal
A few weeks ago I started using Warp a terminal written in rust. Though in it’s current state of development there are a few caveats (tab...
/rust#terminal
52 6785 22
New
PragmaticBookshelf
Backend>Learning Resources

Agile Web Development with Rails 7
Rails 7 completely redefines what it means to produce fantastic user experiences and provides a way to achieve all the benefits of single...
pragprog.com
#pragprog#web-development/ruby/rails#published-book/book-agile-web-development-with-rails-7
32 6600 9
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Jamis Buck (Author) Interview and AMA!
Author Spotlight Jamis Buck @jamis This month, we have the pleasure of spotlighting author Jamis Buck, who has written Mazes for Prog...
#author-spotlight/ruby/book-the-ray-tracer-challenge/book-mazes-for-programmers
21 6352 9
New
PragmaticBookshelf
Backend>Learning Resources

Programming Ruby 3.2 (5th Edition)
Programming Ruby is the most complete book on Ruby, covering both the language itself and the standard library as well as commonly used t...
twitter.com
#pragprog/ruby/rails#published-book/book-programming-ruby-3-2-5th-edition
28 8550 13
New
AnfaengerAlex
Android>Questions

Unresolved Reference to android in build.gradle.kts – Beginner Issue
Hello, I’m a beginner in Android development and I’m facing an issue with my project setup. In my build.gradle.kts file, I have the foll...
#binding
0 7460 2
New
PragmaticBookshelf
Backend>Learning Resources

The Art of Functional Programming
A masterclass in the fundamentals and principles of functional programming. Minh Quang Tran The Art of Functional Programming is a ma...
pragprog.com
#pragprog/haskell/java#published-book/book-the-art-of-functional-programming
2 9360 1
New
NewsBot
Backend>Official News

Node.js v22.14.0 released!
Node.js v22.14.0 has been released. Link: Release 2025-02-11, Version 22.14.0 'Jod' (LTS), @aduh95 · nodejs/node · GitHub
github.com
/nodejs#official-news
0 4251 0
New
PragmaticBookshelf
Backend>Learning Resources

Eloquent Ruby, Second Edition
Write elegant Ruby code—not just correct, but idiomatic. Go beyond the vocabulary and syntax and learn to express yourself with eloquence...
pragprog.com
#pragprog/ruby#published-book/book-eloquent-ruby-second-edition
11 7668 8
New
Back to top

Sponsor Spotlight

EEF

Supporting innovation across the BEAM ecosystem.

General Dev>In The News

General Dev In The News ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap