Backend>Questions

Open datasets that are in SQLite format or convertible to it?

dimitarvp

dimitarvp

Open datasets that are in SQLite format or convertible to it?

Hey everyone,
I resumed work on my Elixir <=> SQLite library (which uses a Rust NIF underneath) and I am in a need of small and well-structured open datasets, preferably directly saved as an SQLite DB – but they could very well be everything else, as long as they can be easily and quickly converted to SQLite.

I downloaded the much-known Chinook DB but it’s a bit too big for my tastes. I plan to bundle a small DB with my library so end-to-end integration tests can be ran on it and that means that the DB must be extremely minimal (no more than 100KB).

Any ideas are appreciated.

(Cross-posting to ElixirForum for visibility.)

6 comments
/elixir#sqlite
11 1344 6

Marked As Solved

dimitarvp

dimitarvp

Figured I’ll settle on this one, I liked it: https://www.sqltutorial.org/sql-sample-database/

There are links to two files at the bottom that (a) create the tables and (b) populate them. (And the resulting sqlite3 db file is 40KB)

1
Post #4

Also Liked

dimitarvp

dimitarvp

Lately did some Rust code reorganization. Next up is finding a minimal locking implementation since sqlite3 is quite liberal with locks (but even it can break if several very particular operations are done in parallel – even if they are allowed by sqlite3).

Still, for an MVP I want something that’s with zero locking lag.

To be fair, the Elixir part seems quite easy – albeit laborous. I am prioritizing making the Rust code to be the best possible first.

3
Post #7
axelson

axelson

https://datasette.io/ Has some great sample SQLite datasets listed in their getting started.

I’m looking forward to trying out xqlite!

2
Post #8
dimitarvp

dimitarvp

Here’s a page that links to one that’s not bad (49KB): https://www.w3resource.com/sqlite-exercises/

Link to the DB itself: https://www.w3resource.com/sqlite-exercises/hr

1
Post #3

Where Next?

View thread on forum
elixir
sqlite
Home Backend>Questions
/elixir#sqlite
11 1344 6
Last post

Popular Backend topics Top

AstonJ
Backend>Questions

Erlang's not installing on macOS Big Sur "You are natively building Erlang/OTP for a later version of MacOSX than current version"
Just done a fresh install of macOS Big Sur and on installing Erlang I am getting: asdf install erlang 23.1.2 Configure failed. checking ...
#macos/erlang#big-sur#asdf
10 6212 8
New
GermaVinsmoke
Backend>Questions

Programming Elixir or Elixir in Action?
Reading Programming Elixir 1.6 book, I’ve completed part 1 of the book. Now I’m thinking of reading Elixir in Action. What do you all sug...
/elixir
34 2021 8
New
brennan
Backend>Questions

When should you use Phoenix LiveView over Phoenix Channels?
When should you use Phoenix LiveView over Phoenix Channels?
/elixir/phoenix#liveview
8 1356 2
New
TwistingTwists
Backend>Questions

Novice developer hoping to learn Elixir - any tips?
Hello Folks, I am a novice developer from India. Intending to learn Elixir and web apps (phoenix framework). What are things that I MUS...
/elixir#beginner#suggestion
53 1792 14
New
Fl4m3Ph03n1x
Backend>Questions

Dialyzer does not catch errors on returned functions
Background While playing around with dialyzer, typespecs and currying, I was able to create an example of a false positive in dialyzer. ...
/elixir
13 1368 6
New
Fl4m3Ph03n1x
Backend>Questions

How to have custom enconding for struct using Jason?
Background I am trying to encode a structure into json format using the Jason library. However, this is not working as expected. Code L...
/elixir#json
6 2879 1
New
Fl4m3Ph03n1x
Backend>Questions

Elixir Witchcraft IO monad?
Background I have recently been delving into more functional code. My objective right now is to get something similar to the IO Monad (in...
/elixir#monads
3 1158 1
New
Ora2pgnewbie
Backend>Questions

Is there a UI for Ora2Pg?
Wanted to check if there is a UI available to use Ora2pg tool.
#postgres/postgresql#ora2pg
2 1524 2
New
sona11
Backend>Questions

In Couchbase, how do you change the datatype of an attribute from String to Array?
I’m having a difficulty. I want to modify an attribute’s data type from String to Array. { “id”: “trn:tarb:tradingpartner:uuid:00000...
/java
2 843 0
New
Fl4m3Ph03n1x
Backend>Questions

(ArgumentError) unknown application: :bakeware
Background When trying to execute mix release on a Windows 11 machine for a Phoenix project I get the following error: * assembling mark...
/elixir#deployments
2 746 1
New

Other popular topics Top

PragmaticBookshelf
Data Science

Genetic Algorithms in Elixir
From finance to artificial intelligence, genetic algorithms are a powerful tool with a wide array of applications. But you don't need an ...
#pragprog#ai/elixir#published-book/book-genetic-algorithms-in-elixir
25 5243 6
New
Maartz
General Dev>Dev Chat

Roc Language - a new purely functional programming language built for speed and ergonomics
Hi folks, I don’t know if I saw this here but, here’s a new programming language, called Roc Reminds me a bit of Elm and thus Haskell. ...
#programminguages#functional-programming
49 5164 14
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Mike Riley (Author) Interview and AMA!
Author Spotlight Mike Riley @mriley This month, we turn the spotlight on Mike Riley, author of Portable Python Projects. Mike’s book ...
#author-spotlight/python#iot/book-portable-python-projects#internet-of-things
62 7035 19
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Bruce Tate (Author) Interview and AMA!
Author Spotlight: Bruce Tate @redrapids Programming languages always emerge out of need, and if that’s not always true, they’re defin...
/elixir/ruby/phoenix/book-seven-more-languages-in-seven-weeks/book-seven-languages-in-seven-weeks#liveview/book-programming-phoenix-liveview
54 5678 23
New
PragmaticBookshelf
Backend>Learning Resources

Ash Framework
Explore the power of Ash Framework by modeling and building the domain for a real-world web application. Rebecca Le @sevenseacat and ...
pragprog.com
#pragprog/elixir#published-book/ash/book-ash-framework
15 7555 9
New
PragmaticBookshelf
Backend>Learning Resources

The New and Improved Flask Mega-Tutorial
Overarching tutorial for Python beginner and intermediate developers that teaches web development with the Flask framework. Miguel Gr...
blog.miguelgrinberg.com
#pragprog/python/flask#published-book/book-the-new-and-improved-flask-mega-tutorial
1 3553 0
New
RobertRichards
Game Dev>Chat

Hair Salon Games for Girls Fun
Hair Salon Games for Girls Fun Girls Hair Saloon game is mainly developed for kids. This game allows users to select virtual avatars to ...
#ios#android#unity#fun
2 3556 1
New
PragmaticBookshelf
Backend>Learning Resources

MySQL 9 Essentials
A concise guide to MySQL 9 database administration, covering fundamental concepts, techniques, and best practices. Neil Smyth MySQL...
pragprog.com
#pragprog#published-book/mysql/book-mysql-9-essentials
2 4162 0
New
PragmaticBookshelf
Backend>Learning Resources

Elixir Patterns
This book forgoes the abstract and instead provides concrete examples to help you better leverage the unique properties of Elixir, Erlang...
pragprog.com
#pragprog/elixir/erlang#published-book#beam/book-elixir-patterns
2 3476 2
New
PragmaticBookshelf
Backend>Learning Resources

Eloquent Ruby, Second Edition
Write elegant Ruby code—not just correct, but idiomatic. Go beyond the vocabulary and syntax and learn to express yourself with eloquence...
pragprog.com
#pragprog/ruby#published-book/book-eloquent-ruby-second-edition
11 7668 8
New
Back to top

Sponsor Spotlight

coders51

We build reliable cloud platforms for business-critical systems.

Latest in Elixir

Elixir Portal ❯

Backend>Questions

Backend Questions ❯

Latest on Devtalk

Devtalk ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

Categories:

Sub Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Honeybadger

Real-time error tracking, performance insights, and observability for devs.

EEF

Supporting innovation across the BEAM ecosystem.

coders51

We build reliable cloud platforms for business-critical systems.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that move you from confusion to "Aha, now I get it!"

Linux New Media

Publishing Linux Magazine, ADMIN, and MakerSpace for 25+ years.

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap