Backend>Questions

Open datasets that are in SQLite format or convertible to it?

dimitarvp

dimitarvp

Open datasets that are in SQLite format or convertible to it?

Hey everyone,
I resumed work on my Elixir <=> SQLite library (which uses a Rust NIF underneath) and I am in a need of small and well-structured open datasets, preferably directly saved as an SQLite DB – but they could very well be everything else, as long as they can be easily and quickly converted to SQLite.

I downloaded the much-known Chinook DB but it’s a bit too big for my tastes. I plan to bundle a small DB with my library so end-to-end integration tests can be ran on it and that means that the DB must be extremely minimal (no more than 100KB).

Any ideas are appreciated.

(Cross-posting to ElixirForum for visibility.)

6 comments
/elixir#sqlite
11 1208 6

Marked As Solved

dimitarvp

dimitarvp

Figured I’ll settle on this one, I liked it: https://www.sqltutorial.org/sql-sample-database/

There are links to two files at the bottom that (a) create the tables and (b) populate them. (And the resulting sqlite3 db file is 40KB)

1
Post #4

Also Liked

dimitarvp

dimitarvp

Lately did some Rust code reorganization. Next up is finding a minimal locking implementation since sqlite3 is quite liberal with locks (but even it can break if several very particular operations are done in parallel – even if they are allowed by sqlite3).

Still, for an MVP I want something that’s with zero locking lag.

To be fair, the Elixir part seems quite easy – albeit laborous. I am prioritizing making the Rust code to be the best possible first.

3
Post #7
axelson

axelson

https://datasette.io/ Has some great sample SQLite datasets listed in their getting started.

I’m looking forward to trying out xqlite!

2
Post #8
dimitarvp

dimitarvp

Here’s a page that links to one that’s not bad (49KB): https://www.w3resource.com/sqlite-exercises/

Link to the DB itself: https://www.w3resource.com/sqlite-exercises/hr

1
Post #3

Where Next?

View thread on forum
elixir
sqlite
Home Backend>Questions
/elixir#sqlite
11 1208 6
Last post

Popular Backend topics Top

mrmurphy
Backend>Questions

How exactly does phx-update detect changes?
I’ve run into a situation where I’ve got a list of posts inside of a container that uses phx-update=“prepend”, and the posts on the socke...
/elixir
16 1079 6
New
s2k
Backend>Questions

An ERB/bundler behaviour I don't understand
I have this code in a file that’s used to … render templates. require 'erb' require 'ostruct' MISSING_CONFIG_MARKER = :config_key_and_v...
/ruby
11 1282 4
New
bsek43
Backend>Questions

Phoenix LiveView learning resources?
Hello everyone, I’ve started learning Elixir and Phoenix few months ago and while I mostly grasped Elixir’s functional concepts and Phoe...
/phoenix
10 1394 3
New
Fl4m3Ph03n1x
Backend>Questions

How to have custom enconding for struct using Jason?
Background I am trying to encode a structure into json format using the Jason library. However, this is not working as expected. Code L...
/elixir#json
6 2725 1
New
JimmyCarterSon
Backend>Questions

Troubleshooting Code: (KeyError) key :changeset not found
I am following this tutorial . I have followed carefully correcting errors as I go. The app allows you to create a blog post and add comm...
/elixir#debugging#troubleshooting
9 2419 3
New
Fl4m3Ph03n1x
Backend>Questions

How to define Macro for a new Type?
Background So, I am playing around with a concept named “NewType” and I am taking inspiration from languages like F# and Scala. My objec...
/elixir#types
22 1313 9
New
MarkIden
Backend>Questions

What is better to start study GO ? Book or course?
Hi, Recommend pls your favorite learning resources in Go, with best books, podcasts etc.
/go
6 1324 5
New
harwind
Backend>Questions

Backend Development: How Can I Optimize My Python Flask API for Better Performance?
I’m presently working on a backend development project to build a RESTful API using Python and Flask. The Scaler backend developer site h...
/python#backend
1 872 0
New
pillaiindu
Backend>Questions

What is the difference between using `:references` and `:belongs_to` in a generate command in Rails?
What is the difference between using :references and :belongs_to in the following command? bin/rails generate scaffold LineItem product:...
/ruby/rails
5 660 2
New
jaeyson
Backend>Questions

Clarifications with the terms regarding augmenting AI in your code
Hi! I have clarifications (please correct me, as I mostly mix/confuse this details) with the following: The term RAG here where it read...
#question#help-needed
1 373 0
New

Other popular topics Top

PragmaticBookshelf
Game Dev>Learning Resources

Apple Game Frameworks and Technologies
Design and develop sophisticated 2D games that are as much fun to make as they are to play. From particle effects and pathfinding to soci...
pragprog.com
#pragprog#ios#game-dev#macos/swift#published-book#apple/book-apple-game-frameworks-and-technologies
30 6234 10
New
AstonJ
General Dev>Hardware

Keyboard thock (sound)
I’ve been hearing quite a lot of comments relating to the sound of a keyboard, with one of the most desirable of these called ‘thock’, he...
/keyboards#mechanical-keyboards
14 9747 8
New
AstonJ
General Dev>Hardware

BIIP MT3 Extended 2048 Custom Keycap Set (Drop)
This looks like a stunning keycap set :orange_heart: A LEGENDARY KEYBOARD LIVES ON When you bought an Apple Macintosh computer in the e...
/keyboards#apple#keycaps#mechanical-keyboards
14 6365 7
New
Exadra37
Linux>Questions

What is the most minimalist Linux server distro?
I am asking for any distro that only has the bare-bones to be able to get a shell in the server and then just install the packages as we ...
#linux#servers
66 23964 24
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: VM Brasseur (Author) Interview and AMA!
Author Spotlight: VM Brasseur @vmbrasseur We have a treat for you today! We turn the spotlight onto Open Source as we sit down with V...
#author-spotlight/book-forge-your-future-with-open-source
16 4431 11
New
CommunityNews
General Dev>In The News

X can’t stop spread of explicit, fake AI Taylor Swift images
Will Swifties’ war on AI fakes spark a deepfake porn reckoning?
arstechnica.com
/swift
0 7404 0
New
AstonJ
Backend>Questions

Psql: error: connection to server on socket "/tmp/.s.PGSQL.5432" failed: No such file or directory
If you’re getting errors like this: psql: error: connection to server on socket “/tmp/.s.PGSQL.5432” failed: No such file or directory ...
#macos/rails/postgresql
1 4231 1
New
AstonJ
AI>In The News

DeepSeek (671B) running on a cluster of 8 Mac Mini Pros with 64GB RAM each
This is cool! DEEPSEEK-V3 ON M4 MAC: BLAZING FAST INFERENCE ON APPLE SILICON We just witnessed something incredible: the largest open-s...
#ai#macs/deepseek
0 5576 1
New
NewsBot
Backend>Official News

Node.js v22.14.0 released!
Node.js v22.14.0 has been released. Link: Release 2025-02-11, Version 22.14.0 'Jod' (LTS), @aduh95 · nodejs/node · GitHub
github.com
/nodejs#official-news
0 2585 0
New
Fl4m3Ph03n1x
AI>Questions

What are the best text-to-speech ai generation tools that you can run locally?
Background Lately I am in a quest to find a good quality TTS ai generation tool to run locally in order to create audio for some videos I...
#ai#text-to-speech
6 5092 3
New
Back to top

Sponsor Spotlight

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Latest in Elixir

Elixir Portal ❯

Backend>Questions

Backend Questions ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap