dimitarvp

dimitarvp

Open datasets that are in SQLite format or convertible to it?

Hey everyone,
I resumed work on my Elixir <=> SQLite library (which uses a Rust NIF underneath) and I am in a need of small and well-structured open datasets, preferably directly saved as an SQLite DB – but they could very well be everything else, as long as they can be easily and quickly converted to SQLite.

I downloaded the much-known Chinook DB but it’s a bit too big for my tastes. I plan to bundle a small DB with my library so end-to-end integration tests can be ran on it and that means that the DB must be extremely minimal (no more than 100KB).

Any ideas are appreciated.

(Cross-posting to ElixirForum for visibility.)

Marked As Solved

dimitarvp

dimitarvp

Figured I’ll settle on this one, I liked it: https://www.sqltutorial.org/sql-sample-database/

There are links to two files at the bottom that (a) create the tables and (b) populate them. (And the resulting sqlite3 db file is 40KB)

Also Liked

dimitarvp

dimitarvp

Lately did some Rust code reorganization. Next up is finding a minimal locking implementation since sqlite3 is quite liberal with locks (but even it can break if several very particular operations are done in parallel – even if they are allowed by sqlite3).

Still, for an MVP I want something that’s with zero locking lag.

To be fair, the Elixir part seems quite easy – albeit laborous. I am prioritizing making the Rust code to be the best possible first.

axelson

axelson

https://datasette.io/ Has some great sample SQLite datasets listed in their getting started.

I’m looking forward to trying out xqlite!

dimitarvp

dimitarvp

Here’s a page that links to one that’s not bad (49KB): https://www.w3resource.com/sqlite-exercises/

Link to the DB itself: https://www.w3resource.com/sqlite-exercises/hr

Where Next?

Popular Backend topics Top

Rainer
Is there somewhere a good introduction to rust for experienced programmers (with years of C++/C#/Java experience)? Wanted to give it a t...
New
andrea
Can Phoenix LiveView be used in multi-page applications, unlike React/Vue/Blazor which seems to be targeted for SPA?
New
gagan7995
API 4 Path: /user/following/ Method: GET Description: Returns the list of all names of people whom the user follows Response [ { ...
New
Fl4m3Ph03n1x
Background I am trying to find a cheap and easy way to create New Types in Elixir, and Records seem to be just what I would need. Probl...
New
Fl4m3Ph03n1x
Background So, I am playing around with a concept named “NewType” and I am taking inspiration from languages like F# and Scala. My objec...
New
Manish_bose
Can anyone help me how to convert a long data to wide data in SQL without using hard coding? Regards Manish
New
sona11
If isReachable throws an IOException in Java, what is the right step to do and why? The application, I believe, should halt the process ...
New
Fl4m3Ph03n1x
Background I have to queries that return a colossal amount of data on their own. I cannot use Repo.all as doing so would materialize thes...
New
AstonJ
If you’re getting errors like this: psql: error: connection to server on socket “/tmp/.s.PGSQL.5432” failed: No such file or directory ...
New
Fl4m3Ph03n1x
Background As I often do, I read books to learn and improve myself. I also enjoy teaching and helping others when I can, so this is somet...
New

Other popular topics Top

AstonJ
What chair do you have while working… and why? Is there a ‘best’ type of chair or working position for developers?
New
New
AstonJ
Curious to know which languages and frameworks you’re all thinking about learning next :upside_down_face: Perhaps if there’s enough peop...
New
AstonJ
You might be thinking we should just ask who’s not using VSCode :joy: however there are some new additions in the space that might give V...
New
Rainer
My first contact with Erlang was about 2 years ago when I used RabbitMQ, which is written in Erlang, for my job. This made me curious and...
New
DevotionGeo
The V Programming Language Simple language for building maintainable programs V is already mentioned couple of times in the forum, but I...
New
AstonJ
Was just curious to see if any were around, found this one: I got 51/100: Not sure if it was meant to buy I am sure at times the b...
New
PragmaticBookshelf
Author Spotlight Rebecca Skinner @RebeccaSkinner Welcome to our latest author spotlight, where we sit down with Rebecca Skinner, auth...
New
DevotionGeo
I have always used antique keyboards like Cherry MX 1800 or Cherry MX 8100 and almost always have modified the switches in some way, like...
New
NewsBot
Node.js v22.14.0 has been released. Link: Release 2025-02-11, Version 22.14.0 'Jod' (LTS), @aduh95 · nodejs/node · GitHub
New