AstonJ

AstonJ

Lunatic - An Erlang inspired runtime for all programming languages (WebAssembly)

More cool tech inspired by erlang :nerd_face:

By combining the fault-tolerance and massive concurrency of Erlang with the capability-based security of WebAssembly, it creates a powerful programming model.

Architecture

Lunatic is a single executable and runs on Windows, macOS and Linux. It spawns lightweight processes from WebAssembly modules that have their own heap/stack. These processes are preemptively scheduled on a multi-threaded executor.

Processes

Lunatic’s design is all about super lightweight processes. Processes are fast to create, have a small memory footprint and a low scheduling overhead. They are designed for massive concurrency.

Isolation

Lunatic sits between your operating system and the running processes. This allows it to decide on a per process basis what syscalls are going to be forwarded to the operating systems.

If you would like to run some untrusted code, you can. Just spawn it inside of a process without any privileges.

Most Liked

mindriot

mindriot

This looks pretty interesting and I’ve not fully got my head into the details yet however I think you have possibly put this into the wrong category. The first thought I got from the first few paragraphs was this was looking like something in the realm of Lumen but taking inspiration from BEAM / Erlang rather than implementing it. It seems however it is a server side thing.

From the FAQ page:

What is Lunatic?
Lunatic is a universal runtime for fast, robust, and scalable server-side applications. It’s inspired by Erlang and can be used from any language that compiles to WebAssembly.

From what I can wrap my head around this seems to be an Erlang inspired web assembly runtime environment allowing people to run web assembly modules of some kind as something similar to processes. It claims to do many of the core things like isolation, own stack/heap, inter process messaging, pre-emptive scheduling, super light processes, big concurrency… but the processes themselves execute WASM and it seems like runtime features are surfaced through libraries. I think the idea is building backends from loads of tiny WASM things that live in and talk to each other on a BEAM like runtime layer.

bkolobara

bkolobara

Creator of Lunatic

Hi! I’m Bernard, the creator of Lunatic.

Thanks you @AstonJ for sharing our project.

I think @mindriot pretty much nailed the core idea behind it.

It doesn’t need to be just “loads of tiny WASM” things, it can only be one WASM module that spawns processes from functions defined inside it. Lunatic should be usable for small projects to really big one. I love using it myself to play around with small side projects.

Lunatic can offer a bit more powerful per process isolation than you get on the BEAM. E.g:

  1. You can spawn a process that can only use a limited amount of memory or CPU.
  2. You can use C bindings without fear. Once everything is compiled to WebAssembly, long running code will still be preempted and crashes don’t escape the process boundary.
  3. You can limit syscalls on a per process level, e.g. spawn this process but don’t let any code running in it open a network connection.
  4. Redirect syscallls, e.g. if this process writes to a log file redirect the stream over the network to an Elastic cluster.
  5. You can use it from you favourite language if it compiles to WebAssembly. Currently we only provide libraries for Rust and AssemblyScript.

A long term goal of the project is to be able to take some codebase, let’s say a C project, recompile it to WebAssembly and run it on top of Lunatic. If you use threads in your project, we abstract them with much more lightweight processes that share memory. If you do a blocking network read, we just take this thread off the executor until the data arrives. We want to bring as many benefits of Erlang to other languages with the least amount of work required from the developer and stay close to the existing APIs of each language.

If anyone has some questions, I would be happy to answer them.

dimitarvp

dimitarvp

So glad having you here!

One starting question from my side would be: do you have any testing harness in place that confirms that Lunatic has the runtime guarantees that the OTP has?

I am really loving Elixir and the BEAM but speed and efficiency can be a concern. If we get to a point where a Rust levels of performance runtime exists with all OTP guarantees then I’ll be an immediate convert.

Where Next?

Popular Backend topics Top

First poster: bot
Quarkus 1.9.1.Final has been released. Link: Release 1.9.1.Final · quarkusio/quarkus · GitHub
New
First poster: bot
Julia v1.6.0-rc3 has been released. Link: Release v1.6.0-rc3 · JuliaLang/julia · GitHub
New
First poster: bot
A new Haskell blog post/announcement has been posted! Get the full details here: GHC 9.2.1-alpha2 now available — The Glasgow Haskell C...
New
NewsBot
Gleam v0.16.0 and v0.16.0-rc4 has been released. Link: Release v0.16.0 · gleam-lang/gleam · GitHub Link: Release v0.16.0-rc4 · gleam-...
New
First poster: bot
Node.js v14.18.2 has been released. Link: Release 2021-11-30, Version 14.18.2 'Fermium' (LTS), @richardlau · nodejs/node · GitHub
New
First poster: bot
V weekly.2021.50.3 has been released. Link: Release weekly.2021.50.3 · vlang/v · GitHub
New
First poster: bot
Node.js v14.18.3 and v12.22.9 has been released. Link: Release 2022-01-10, Version 14.18.3 'Fermium' (LTS), @richardlau · nodejs/node ·...
New
First poster: bot
A new Rust blog post/announcement has been posted! Get the full details here: Security advisory for the regex crate (CVE-2022-24713) | ...
New
First poster: bot
Julia v1.9.0-beta1 has been released. Link: Release v1.9.0-beta1 · JuliaLang/julia · GitHub
New
NewsBot
Julia v1.10.0-alpha1 has been released. Link: Release v1.10.0-alpha1 · JuliaLang/julia · GitHub
New

Other popular topics Top

AstonJ
Or looking forward to? :nerd_face:
New
Exadra37
Please tell us what is your preferred monitor setup for programming(not gaming) and why you have chosen it. Does your monitor have eye p...
New
dasdom
No chair. I have a standing desk. This post was split into a dedicated thread from our thread about chairs :slight_smile:
New
Rainer
My first contact with Erlang was about 2 years ago when I used RabbitMQ, which is written in Erlang, for my job. This made me curious and...
New
AstonJ
I’ve been hearing quite a lot of comments relating to the sound of a keyboard, with one of the most desirable of these called ‘thock’, he...
New
PragmaticBookshelf
“A Mystical Experience” Hero’s Journey with Paolo Perrotta @nusco Ever wonder how authoring books compares to writing articles?...
New
mafinar
Crystal recently reached version 1. I had been following it for awhile but never got to really learn it. Most languages I picked up out o...
New
AstonJ
We’ve talked about his book briefly here but it is quickly becoming obsolete - so he’s decided to create a series of 7 podcasts, the firs...
New
New
PragmaticBookshelf
Author Spotlight: VM Brasseur @vmbrasseur We have a treat for you today! We turn the spotlight onto Open Source as we sit down with V...
New