Backend>Blogs/Talks

Inserting One Billion Rows in SQLite Under A Minute

CommunityNews

CommunityNews

Inserting One Billion Rows in SQLite Under A Minute

Recently, I ran into a situation where I needed a test database with lots of rows and needed it fast. So I did what any programmer would do: wrote a Python script to generate the DB. Unfortunately, it was slow. Really slow. So I did what any programmer would do: went down the rabbit hole of learning more about SQLite, Python, and eventually Rust… in my quest to get a 1B row database under a minute. This blog post is a summary of this fun and educational exercise.

Read in full here:

This thread was posted by one of our members via one of our news source trackers.

View thread on forum
/python/rust#sqlite
0 939 0

Where Next?

View thread on forum
python
rust
sqlite
Home Backend>Blogs/Talks
/python/rust#sqlite
0 939 0
Last post

Popular Backend topics Top

CommunityNews
Backend>Blogs/Talks

Is Zig the Long Awaited C Replacement
Is Zig the Long Awaited C Replacement. Comparison with previous C contenders such as C++, D, Java, C#, Go, Rust and Swift https://erik...
erik-engheim.medium.com
/c/c-plus-plus/rust/swift/zig/v
4 1935 1
New
First poster: wolf4earth
Backend>Blogs/Talks

Understanding Partial Moves in Rust
Understanding Partial Moves in Rust. Partial moves are an interesting but often misunderstood feature of Rust. However, with the right ...
whileydave.com
/rust
8 1386 4
New
First poster: bot
Backend>Blogs/Talks

Revisiting a Video Chat Application with Phoenix and WebRTC
In a previous post we talked about implementing a simple video chat with WebRTC and Elixir. This update will touch on some of the API cha...
hashrocket.com
/phoenix#chat#video#webrtc
1 1698 0
New
First poster: bot
Backend>Blogs/Talks

What's Next for Teal, the typed dialect of Lua
What’s Next for Teal, the typed dialect of Lua - FOSDEM 2021. This is my talk about the latest updates on the Teal programming language,...
youtube.com
/lua
0 1114 0
New
brainlid
Backend>Blogs/Talks

ThinkingElixir 052 - IOList and Postgres with Nathan Long
We take a deeper dive with Nathan Long into IOLists in Elixir. We cover what they are, how they work, the power they have when concatenat...
thinkingelixir.com
/elixir/phoenix#postgres#podcasts
5 1098 0
New
AstonJ
Backend>Blogs/Talks

This is the Future of Webdev. Crazy, Right?
This was posted on the Elixir Forum and thought it was worth sharing here! I love how the excitement of the author shines through and I ...
suzdalnitski.medium.com
/phoenix#blog-post#liveview#elixr
12 1156 4
New
wolf4earth
Backend>Blogs/Talks

Podcast: ElixirMix 139 - Gleam and Typing ft. Louis Pilfold
Louis Pilfold is the creator of the Gleam programming language. He explains what Gleam is and tells us where it came from. He then dives...
devchat.tv
/elixir/gleam#beam#podcasts#types
4 1223 0
New
elbrujohalcon
Backend>Blogs/Talks

Oldies but Goldies: Scaling Erlang | By Brujo Benavides | Tealfeed
An old article that I just reshared on TealFeed… :zombie:
tealfeed.com
/erlang/java#article
4 1088 0
New
brainlid
Backend>Blogs/Talks

ThinkingElixir 092 - Temple with Mitchell Hanberg
In episode 92 of Thinking Elixir, we talk with Mitchell Hanberg and learn about why he created the alternate Phoenix templating language ...
podcast.thinkingelixir.com
/elixir#podcasts#testing#browser/html#dev-news-source
4 1062 0
New
StuntProgrammer
Backend>Blogs/Talks

Media Storage and CDN with Phoenix and Elixir
In building lofi.limo, media storage and distribution naturally came up. I have songs, announcements, and background image loops which I ...
lofi.limo
/elixir#article
20 1096 5
New

Other popular topics Top

Devtalk
General Dev>Dev Chat

HELLO WORLD (Introductions thread!)
Hello Devtalk World! Please let us know a little about who you are and where you’re from :nerd_face:
#community
476 5728 111
New
AstonJ
Backend>Questions

Erlang's not installing on macOS Big Sur "You are natively building Erlang/OTP for a later version of MacOSX than current version"
Just done a fresh install of macOS Big Sur and on installing Erlang I am getting: asdf install erlang 23.1.2 Configure failed. checking ...
#macos/erlang#big-sur#asdf
10 5616 8
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Paolo Perrotta (Author)
“A Mystical Experience” Hero’s Journey with Paolo Perrotta @nusco Ever wonder how authoring books compares to writing articles?...
#community#author-spotlight/book-programming-machine-learning/book-metaprogramming-ruby-2
31 3538 15
New
PragmaticBookshelf
Backend>Learning Resources

Programming Phoenix LiveView
Build highly interactive applications without ever leaving Elixir, the way the experts do. Let LiveView take care of performance, scalabi...
pragprog.com
#pragprog/elixir/phoenix#published-book/book-programming-phoenix-liveview
61 3882 14
New
AstonJ
General Dev>Dev Chat

Languages Without Garbage Collection
Continuing the discussion from Thinking about learning Crystal, let’s discuss - I was wondering which languages don’t GC - maybe we can c...
#garbage-collection
21 4800 7
New
gagan7995
Backend>Questions

Please tell me how to write a query for this in nodejs
API 4 Path: /user/following/ Method: GET Description: Returns the list of all names of people whom the user follows Response [ { ...
/nodejs
7 3059 3
New
AstonJ
General Dev>Hardware

CharaChorder - type at the speed of thought?
Saw this on TikTok of all places! :lol: Anyone heard of them before? Lite:
/keyboards#charachorder
13 3957 4
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Rebecca Skinner (Author) Interview and AMA!
Author Spotlight Rebecca Skinner @RebeccaSkinner Welcome to our latest author spotlight, where we sit down with Rebecca Skinner, auth...
#author-spotlight/haskell/book-effective-haskell
106 10605 28
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Peter Ullrich (Author) Interview and AMA!
Author Spotlight: Peter Ullrich @PJUllrich Data is at the core of every business, but it is useless if nobody can access and analyze ...
/elixir/phoenix/book-building-table-views-with-phoenix-liveview
72 3959 21
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Sophie DeBenedetto (Author) Interview and AMA!
Author Spotlight: Sophie DeBenedetto @SophieDeBenedetto The days of the traditional request-response web application are long gone, b...
/elixir/phoenix#liveview/book-programming-phoenix-liveview
37 3237 14
New
Back to top

Sponsor Spotlight

Manning

Develop your skills with books, videos, and courses.

Latest in Python

Python Portal ❯

Latest in Rust

Rust Portal ❯

Backend>Blogs/Talks

Backend Blogs/Talks ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap