Pragmatic>PragProg

Machine Learning in Elixir: Understanding text with FNNs vs RRNs (219)

polmiro

polmiro

Machine Learning in Elixir: Understanding text with FNNs vs RRNs (219)

@seanmor5

In the chapter about “Understanding Text” a FFN is implemeneted that outputs an accuracy of 0.7676411 on the test dataset in page 213. Then the book moves on to implement an RNN that outputs an accuracy of 0.7510081 on the test dataset in page 219. I was a bit puzzled since the expectation and description is that the RNN would perform better but the results proof otherwise.

Is this intentional? Or perhaps the examples in the book are missing some updates.

2 comments
/book-machine-learning-in-elixir#question
1 288 2

Marked As Solved

seanmor5

seanmor5

Author of Genetic Algorithms in Elixir

Hey @polmiro

There is actually an issue with training RNNs in Axon right now :frowning: Training them is unstable and so results in much worse results than you would normally see. I’m working on fixing the issue, you can track the progress here: Performance diversion between RNN in Keras and Axon · Issue #530 · elixir-nx/axon · GitHub

1
Post #2

Popular Pragmatic topics Top

yulkin
Pragmatic>PragProg

Programming Flutter: Image.toByteData() does not exist (page40)
your book suggests to use Image.toByteData() to convert image to bytes, however I get the following error: "the getter ‘toByteData’ isn’t...
/book-programming-flutter#question
1 4045 2
New
simonpeter
Pragmatic>PragProg

Web Development with Clojure, Third Edition: (create-migration "guestbook") not working (page 9)
When I try the command to create a pair of migration files I get an error. user=> (create-migration "guestbook") Execution error (Ill...
#errata/book-web-development-with-clojure-third-edition
5 1779 4
New
mikecargal
Pragmatic>PragProg

Hands-On Rust: Wrong multiplier for 8x8 console in main.rs
Title: Hands-On Rust (Chap 8 (Adding a Heads Up Display) It looks like ​.with_simple_console_no_bg​(SCREEN_WIDTH*2, SCREEN_HEIGHT*2...
#errata/book-hands-on-rust
9 2012 5
New
joepstender
Pragmatic>PragProg

Programming Phoenix LiveView: errata and remarks Version B2.0
The generated iex result below should list products instead of product for the metadata. (page 67) iex> product = %Product{} %Pento....
#errata/book-programming-phoenix-liveview
0 1798 20
New
adamwoolhether
Pragmatic>PragProg

Distributed Services with Go: receiving Unknown flag: --go_opt when compiling protobuf (page 20)
When trying to generate the protobuf .go file, I receive this error: Unknown flag: --go_opt libprotoc 3.12.3 MacOS 11.3.1 Googling ...
/book-distributed-services-with-go
0 4856 3
New
nicoatridge
Pragmatic>PragProg

Kotlin and Android Development: Could not get unknown property ‘kotlin_version’…
Hi, I have just acquired Michael Fazio’s “Kotlin and Android Development” to learn about game programming for Android. I have a game in p...
/book-kotlin-and-android-development-featuring-jetpack
0 7957 6
New
brunogirin
Pragmatic>PragProg

Python Testing with pytest, Second Edition: unrecognized arguments error (page 122)
When I run the coverage example to report on missing lines, I get: pytest --cov=cards --report=term-missing ch7 ERROR: usage: pytest [op...
#errata/book-python-testing-with-pytest-second-edition
0 3934 1
New
oaklandgit
Pragmatic>PragProg

Hands-on Rust: Failed to Load Texture error (page 121)
Hi, I completed chapter 6 but am getting the following error when running: thread 'main' panicked at 'Failed to load texture: IoError(O...
/book-hands-on-rust
2 1303 3
New
taguniversalmachine
Pragmatic>PragProg

Real-Time Phoenix: ProductChannelTest - undefined function describe/2 (pg 203)
Hi, I am getting an error I cannot figure out on my test. I have what I think is the exact code from the book, other than I changed “us...
#question/book-real-time-phoenix
0 1759 6
New
Keton
Pragmatic>PragProg

Hands-on Rust: How do I debug a call chain in Rust?
When running the program in chapter 8, “Implementing Combat”, the printout Health before attack was never printed so I assumed something ...
#question/book-hands-on-rust
2 1006 2
New

Other popular topics Top

DevotionGeo
Backend>Chat

What is the reason behind Rust’s web framework, Rocket, not performing as well as expected in the Techempower benchmarks?
I know that these benchmarks might not be the exact picture of real-world scenario, but still I expect a Rust web framework performing a ...
/rust#web-frameworks
36 6275 11
New
AstonJ
Science/Tech>Tech Chat

What are you watching?
Or looking forward to? :nerd_face:
#community
480 9177 251
New
DevotionGeo
Backend>Chat

Would you use Erlang now when there is Elixir?
Why, if your answer is yes?
/elixir/erlang
167 4214 52
New
AstonJ
General Dev>Dev Chat

How fast do you type? Check your WPM here!
Do the test and post your score :nerd_face: :keyboard: If possible, please add info such as the keyboard you’re using, the layout (Qw...
typing-speed-test.aoeu.eu
/keyboards
82 6676 31
New
PragmaticBookshelf
Backend>Learning Resources

Programming Phoenix LiveView
Build highly interactive applications without ever leaving Elixir, the way the experts do. Let LiveView take care of performance, scalabi...
pragprog.com
#pragprog/elixir/phoenix#published-book/book-programming-phoenix-liveview
61 2974 14
New
AstonJ
Science/Tech>Health & Diet

Did you manage to avoid covid19?
Seems like a lot of people caught it - just wondered whether any of you did? As far as I know I didn’t, but it wouldn’t surprise me if I...
#covid19
190 3663 79
New
AstonJ
General Dev>Dev Chat

Languages Without Garbage Collection
Continuing the discussion from Thinking about learning Crystal, let’s discuss - I was wondering which languages don’t GC - maybe we can c...
#garbage-collection
21 4532 7
New
AstonJ
General Dev>Hardware

CharaChorder - type at the speed of thought?
Saw this on TikTok of all places! :lol: Anyone heard of them before? Lite:
/keyboards#charachorder
13 3743 4
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Dmitry Zinoviev (Author) Interview and AMA!
Author Spotlight Dmitry Zinoviev @aqsaqal Today we’re putting our spotlight on Dmitry Zinoviev, author of Data Science Essentials in ...
#author-spotlight/python/book-complex-network-analysis-in-python/book-data-science-essentials-in-python/book-resourceful-code-reuse/book-pythonic-programming
33 4606 14
New
PragmaticBookshelf
Community>In The Spotlight

Spotlight: Erin Dees (Author) Interview and AMA!
Author Spotlight Erin Dees @undees Welcome to our new author spotlight! We had the pleasure of chatting with Erin Dees, co-author of ...
#author-spotlight/ruby/rails/book-effective-testing-with-rspec-3#rspec#book-seven-moreuages-in-seven-weeks/book-cucumber-recipes
24 3464 11
New
Back to top

Latest in PragProg

Ash Framework B4.0: Typo (page 83)
PragProg Customers
Hotwire Native for Rails Developers: Collected Errata from our class at the University of Chicago
PragProg Customers
Agile Web Development with Rails 7 p1.0—May2023: foreman Gem (page 73)
PragProg Customers
The Definitive ANTLR 4 Reference: No download link provided for TestSimple.java (Page 240)
PragProg Customers
Programming Phoenix LiveView: Wrong closing element tag (page 106)
PragProg Customers
Programming Phoenix LiveView: Typo (page 103)
PragProg Customers
Programming Phoenix LiveView: Wrong HTML comment tag in example (page 102)
PragProg Customers
Programming Phoenix LiveView: typo missing word (page 101)
PragProg Customers
Agile Web Development with Rails 8 B7.0: order_mailer_test failing (page 196)
PragProg Customers
Simplicity: Let’s Change Our World — Again
PragProg Customers
Simplicity: "detail"→"derail" (page 74, B2.0)
PragProg Customers
Agile Web Development with Rails 8: Page 9
PragProg Customers
Kotlin Coroutine Confidence: Code does not run (pg 225)
PragProg Customers
Agile Web Development with Rails 8 B7.0: partials folder (page 151)
PragProg Customers
Kotlin Coroutine Confidence: Change function name, maybe (pg 182)
PragProg Customers
Modern Front-End Development for Rails, Second Edition: can't get code to run
PragProg Customers
Kotlin Coroutine Confidence: Book & source code do not match (pg 180)
PragProg Customers
Kotlin Coroutine Confidence: Add formatter off/on comments (pg 162)
PragProg Customers
Kotlin Coroutine Confidence: What's the IntelliJ IDEA inspection? (pg 133 & 141)
PragProg Customers
Kotlin Coroutine Confidence: Add `parallel/v9` (pg 125)
PragProg Customers

View all threads ❯

Latest (all)

New Lego-building AI creates models that actually stand up in real life
AI In The News
Detect and crash Chromium bots with one weird trick (bots hate it!)
In The News
Intel: Winning and Losing
In The News
Symfony v7.3.0-BETA2 released!
Backend Official News
Actix web-v4.11.0, http-v3.11.0 and awc-v3.7.0 released!
Backend Official News
Cell Mates: Extracting Useful Information From Tables for LLMs
AI In The News
Odin, A Pragmatic C Alternative with a Go Flavour
Backend In The News
What's new in Swift 6.2?
iOS In The News
New Tool: lsds - List All Linux Block Devices and Settings in One Place - Tanel Poder Consulting
Linux In The News
Kodee’s Kotlin Roundup: Compose Multiplatform for iOS is Stable (Plus AI, Web, and More!)
Backend Official News
Write the most clever code you possibly can
In The News
Dasung Paperlike 13K is a 13.3 inch E Ink color monitor - Liliputing
In The News
V weekly.2025.19 released!
Backend Official News
Wikidive - AI-Guided Wikipedia Exploration
AI In The News
Node.js v24.0.1 released!
Backend Official News

View all threads ❯

We ❤️ helpful members!

We reward our most helpful members via our MOTM scheme - by giving away a whopping 25 books per year!

Member of the Month

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

Categories:

Popular Portals

Devtalk Sponsors

Pragmatic Bookshelf

Practical resources that improve the lives of professional developers.

Erlang Solutions

We build trusted fault-tolerant systems that scale to billions of users.

Manning Publications

Develop your skills with books, videos, and courses.

AppSignal

Catch errors, track performance, monitor hosts and more.

WyeWorks

Enabling companies to succeed by building software people love.

Pragmatic Studio

Courses that'll move you from confusion to "Aha, now I get it!"

View all our sponsors ❯

We're in Beta

About us Mission Statement See our Roadmap