dimitarvp

dimitarvp

Open datasets that are in SQLite format or convertible to it?

Hey everyone,
I resumed work on my Elixir <=> SQLite library (which uses a Rust NIF underneath) and I am in a need of small and well-structured open datasets, preferably directly saved as an SQLite DB – but they could very well be everything else, as long as they can be easily and quickly converted to SQLite.

I downloaded the much-known Chinook DB but it’s a bit too big for my tastes. I plan to bundle a small DB with my library so end-to-end integration tests can be ran on it and that means that the DB must be extremely minimal (no more than 100KB).

Any ideas are appreciated.

(Cross-posting to ElixirForum for visibility.)

Marked As Solved

dimitarvp

dimitarvp

Figured I’ll settle on this one, I liked it: https://www.sqltutorial.org/sql-sample-database/

There are links to two files at the bottom that (a) create the tables and (b) populate them. (And the resulting sqlite3 db file is 40KB)

Also Liked

dimitarvp

dimitarvp

Lately did some Rust code reorganization. Next up is finding a minimal locking implementation since sqlite3 is quite liberal with locks (but even it can break if several very particular operations are done in parallel – even if they are allowed by sqlite3).

Still, for an MVP I want something that’s with zero locking lag.

To be fair, the Elixir part seems quite easy – albeit laborous. I am prioritizing making the Rust code to be the best possible first.

axelson

axelson

https://datasette.io/ Has some great sample SQLite datasets listed in their getting started.

I’m looking forward to trying out xqlite!

dimitarvp

dimitarvp

Here’s a page that links to one that’s not bad (49KB): https://www.w3resource.com/sqlite-exercises/

Link to the DB itself: https://www.w3resource.com/sqlite-exercises/hr

Where Next?

Popular Backend topics Top

Kurisu
Hello, Please, let’s say I have a website with user authentication made with Elixir/Phoenix, and now want to add a forum to it (using a ...
New
DevotionGeo
I know that -t flag is used along with -i flag for getting an interactive shell. But I cannot digest what the man page for docker run com...
New
Kurisu
Hello and happy new year! I would like to buy a Ruby On Rails ebook for learning purpose. What would be the ROR equivalent of “Programm...
New
Jsdr3398
I’ve been working on and rewriting my messaging platform several times for the past two years. With Discords new rebranding, it has reall...
New
Ookma-Kyi
I am learning Elixir at the moment but am finding it difficult to learn. The issue is there aren’t any good tutorial sites out there when...
New
Fl4m3Ph03n1x
Background I am trying to find a cheap and easy way to create New Types in Elixir, and Records seem to be just what I would need. Probl...
New
Fl4m3Ph03n1x
Background I have a personal project that is an elixir desktop application for PC Windows. It works pretty well, but now I want to give i...
New
Fl4m3Ph03n1x
Background I am a fan of dialyzer and friends (looking at Gradient) and I try to have sepcs in my code as much as I can. To this end, I a...
New
sona11
I studied very basic PHP (I believe). After that, I feel like I’ve gotten a handle on the language. My dream is to work as a web develope...
New
Fl4m3Ph03n1x
Background I have an umbrella app where I use a dependecy called ETS. This dependency has a type called set_options that I use in some of...
New

Other popular topics Top

PragmaticBookshelf
Design and develop sophisticated 2D games that are as much fun to make as they are to play. From particle effects and pathfinding to soci...
New
DevotionGeo
I know that -t flag is used along with -i flag for getting an interactive shell. But I cannot digest what the man page for docker run com...
New
AstonJ
You might be thinking we should just ask who’s not using VSCode :joy: however there are some new additions in the space that might give V...
New
Rainer
Not sure if following fits exactly this thread, or if we should have a hobby thread… For many years I’m designing and building model air...
New
AstonJ
If you are experiencing Rails console using 100% CPU on your dev machine, then updating your development and test gems might fix the issu...
New
PragmaticBookshelf
Build highly interactive applications without ever leaving Elixir, the way the experts do. Let LiveView take care of performance, scalabi...
New
gagan7995
API 4 Path: /user/following/ Method: GET Description: Returns the list of all names of people whom the user follows Response [ { ...
New
AstonJ
Biggest jackpot ever apparently! :upside_down_face: I don’t (usually) gamble/play the lottery, but working on a program to predict the...
New
Help
I am trying to crate a game for the Nintendo switch, I wanted to use Java as I am comfortable with that programming language. Can you use...
New
AstonJ
Curious what kind of results others are getting, I think actually prefer the 7B model to the 32B model, not only is it faster but the qua...
New