Backend>Questions

Open datasets that are in SQLite format or convertible to it?

dimitarvp

dimitarvp

Open datasets that are in SQLite format or convertible to it?

Hey everyone,
I resumed work on my Elixir <=> SQLite library (which uses a Rust NIF underneath) and I am in a need of small and well-structured open datasets, preferably directly saved as an SQLite DB – but they could very well be everything else, as long as they can be easily and quickly converted to SQLite.

I downloaded the much-known Chinook DB but it’s a bit too big for my tastes. I plan to bundle a small DB with my library so end-to-end integration tests can be ran on it and that means that the DB must be extremely minimal (no more than 100KB).

Any ideas are appreciated.

(Cross-posting to ElixirForum for visibility.)

6 comments
/elixir#sqlite
11 984 6

Marked As Solved

dimitarvp

dimitarvp

Figured I’ll settle on this one, I liked it: https://www.sqltutorial.org/sql-sample-database/

There are links to two files at the bottom that (a) create the tables and (b) populate them. (And the resulting sqlite3 db file is 40KB)

1
Post #4

Also Liked

dimitarvp

dimitarvp

Lately did some Rust code reorganization. Next up is finding a minimal locking implementation since sqlite3 is quite liberal with locks (but even it can break if several very particular operations are done in parallel – even if they are allowed by sqlite3).

Still, for an MVP I want something that’s with zero locking lag.

To be fair, the Elixir part seems quite easy – albeit laborous. I am prioritizing making the Rust code to be the best possible first.

3
Post #7
axelson

axelson

https://datasette.io/ Has some great sample SQLite datasets listed in their getting started.

I’m looking forward to trying out xqlite!

2
Post #8
dimitarvp

dimitarvp

Here’s a page that links to one that’s not bad (49KB): https://www.w3resource.com/sqlite-exercises/

Link to the DB itself: https://www.w3resource.com/sqlite-exercises/hr

1
Post #3

Where Next?

View thread on forum
elixir
sqlite
Home Backend>Questions
/elixir#sqlite
11 988 6
Last post

Popular Backend topics Top

dimitarvp
Backend>Questions

Give me your quickest Kubernetes guides, please
As a part of my new job I’ll have to learn to manage a local k8s cluster. The tools used are microk8s, tilt and helm. I’ll appreciate an...
#kubernetes
25 769 10
New
AstonJ
Backend>Questions

Erlang's not installing on macOS Big Sur "You are natively building Erlang/OTP for a later version of MacOSX than current version"
Just done a fresh install of macOS Big Sur and on installing Erlang I am getting: asdf install erlang 23.1.2 Configure failed. checking ...
#macos/erlang#big-sur#asdf
10 5471 8
New
jaimeiniesta
Backend>Questions

Screenshots as a service
I maintain a project that lists hundreds of thousands of web pages, and I’d like to show a screenshot for each web page. There are alread...
#screenshots
2 685 1
New
mrmurphy
Backend>Questions

How exactly does phx-update detect changes?
I’ve run into a situation where I’ve got a list of posts inside of a container that uses phx-update=“prepend”, and the posts on the socke...
/elixir
16 859 6
New
JimmyCarterSon
Backend>Questions

Assistance with Schema Mix
I am confused about the Schema setup, I am setting up a new application and I want to seed files in it as well. I tried to mix to create...
/elixir/phoenix#ecto#troubleshooting#mix
18 1063 7
New
MarkIden
Backend>Questions

What is better to start study GO ? Book or course?
Hi, Recommend pls your favorite learning resources in Go, with best books, podcasts etc.
/go
6 1037 5
New
GermaVinsmoke
Backend>Questions

Does anyone know beginner friendly Elixir/Phoenix Open source projects?
Does anyone know beginner friendly Elixir/Phoenix Open source projects? For learning purpose :slightly_smiling_face:
/elixir/phoenix
4 704 2
New
Ora2pgnewbie
Backend>Questions

Is there a UI for Ora2Pg?
Wanted to check if there is a UI available to use Ora2pg tool.
#postgres/postgresql#ora2pg
2 1203 2
New
AstonJ
Backend>Questions

Rails db:create error - PG::ConnectionBad: connection to server on socket "/tmp/.s.PGSQL.5432" failed: FATAL: database "_development" does not exist
If when trying to create (or recreate) your dev db with rails db:create you are getting: PG::ConnectionBad: connection to server on soc...
/rails#troubleshooting
3 1908 0
New
Manish_bose
Backend>Questions

Convert long data to wide data in SQL?
Can anyone help me how to convert a long data to wide data in SQL without using hard coding? Regards Manish
#sql
7 612 2
New

Other popular topics Top

DevotionGeo
Backend>Chat

What is the reason behind Rust’s web framework, Rocket, not performing as well as expected in the Techempower benchmarks?
I know that these benchmarks might not be the exact picture of real-world scenario, but still I expect a Rust web framework performing a ...
#web-frameworks/rust
36 6421 11
New
axelson
Cross Platform>Libraries/Tools

Obsidian – a cross platform app to help you create a knowledge base with Markdown files
I’ve been really enjoying obsidian.md: It is very snappy (even though it is based on Electron). I love that it is all local by defaul...
#apps#macos#windows#linux/markdown#obsidian
38 3913 19
New
brentjanderson
General Dev>Hardware

Moonlander Keyboard (Mechanical) (Ergonomic) (Split) (Ortholinear)
Bought the Moonlander mechanical keyboard. Cherry Brown MX switches. Arms and wrists have been hurting enough that it’s time I did someth...
#hardware/keyboards#moonlander#mechanical-keyboards#ortholinear#ergonomic
212 14831 90
New
DevotionGeo
General Dev>Code Editors

Dendron: a personal knowledge management tool on top of VSCode
/vscode#visual-studio-code
28 5849 9
New
AstonJ
General Dev>Dev Chat

How fast do you type? Check your WPM here!
Do the test and post your score :nerd_face: :keyboard: If possible, please add info such as the keyboard you’re using, the layout (Qw...
typing-speed-test.aoeu.eu
/keyboards
82 6760 31
New
AstonJ
Backend>Chat

How to install Ruby 3 with ASDF
In case anyone else is wondering why Ruby 3 doesn’t show when you do asdf list-all ruby :man_facepalming: do this first: asdf plugin-upd...
/ruby#asdf
11 5235 4
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Jamis Buck (Author) Interview and AMA!
Author Spotlight Jamis Buck @jamis This month, we have the pleasure of spotlighting author Jamis Buck, who has written Mazes for Prog...
#author-spotlight/ruby/book-the-ray-tracer-challenge/book-mazes-for-programmers
21 5465 9
New
AnfaengerAlex
Android>Questions

Unresolved Reference to android in build.gradle.kts – Beginner Issue
Hello, I’m a beginner in Android development and I’m facing an issue with my project setup. In my build.gradle.kts file, I have the foll...
#binding
0 1562 2
New
AstonJ
AI>Chat

Post your DeepSeek results
Curious what kind of results others are getting, I think actually prefer the 7B model to the 32B model, not only is it faster but the qua...
/deepseek
15 861 15
New
Fl4m3Ph03n1x
AI>Questions

What are the best text-to-speech ai generation tools that you can run locally?
Background Lately I am in a quest to find a good quality TTS ai generation tool to run locally in order to create audio for some videos I...
#ai#text-to-speech
6 1332 3
New
Back to top

Latest in Elixir

Elixir Portal ❯

Backend>Questions

Backend Questions ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap