pieteeken

pieteeken

Machine Learning in Elixir: Some remarks on chapter 8 version B2.0 and cuda

@seanmor5

Machine Learning in Elixir

Some remarks on chapter 8 version B2.0
seanmor5

page 177
It is already mentioned here:
:discard is forgotten, it must be Stream.chunk_every(batch_size,batch_size, :discard)
I discovered it after an hour or so. First I tried to form chunks that are a multiple of32.
So I have thrown some pictures away and made 1000 >> 960 and 750 >> 630 (page 178). Fortunately there is :discard

page 184
Already mentioned: Use Polaris.Optimizers.adam(learning_rate: 1.0e-4)

page 191:
github.com/onnx/tensorflow_onnx doesn’t exist (anymore).
Why “Exporting models from …”. Why not “Importing …”

page 193:
unk__613 is now unk__615
The link tfhub.def is changed to Find Pre-trained Models | Kaggle

Then for all who were wondering: Why don’t I see “EXLA.Backend<cuda:…” but always
“EXLA.Backend<host:…”
Install the cuda-toolkit (on developer.nvidia.com/cuda-toolkit)

Do not forget to put in your .bashrc!!!:
export PATH=/usr/local/cuda-12./bin${PATH:+:${PATH}}
export PATH=/usr/local/cuda-12.3/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-12.3/lib64
${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
export XLA_TARGET=cuda120
export EXLA_TARGET=cuda

It did not work with my old graphics card (Geforce GT9600) so I had to buy a new graphics card. An RTX 360, not the most expensive. And it is working now! Everything goes 30-40% faster.

First Post!

pieteeken

pieteeken

The sentence “export PATH=/usr/local/cuda-12./bin${PATH:+:${PATH}}” must be removed/

And the sentence “export LD_LIBRARY_PATH=/usr/local/cuda-12.3/lib64
${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}” should be one line.
I discovered that because I did “source .bashrc” and got an error.

Furthermore you can add to the cuda part the next script because you get the warning a numan node is missing.
I don’t know if it is necessesary, cause I don’t know what a numan node is, but anyway…


#!/bin/bash
if [[ “$EUID” -ne 0 ]]; then
echo “Please run as root.”
exit 1
fi
PCI_ID=$(lspci | grep “VGA compatible controller: NVIDIA Corporation” | cut -d’ ’ -f1)
PCI_ID=“0000:$PCI_ID”
FILE=/sys/bus/pci/devices/$PCI_ID/numa_node
echo Checking $FILE for NUMA connection status…
if [[ -f “$FILE” ]]; then
CURRENT_VAL=$(cat $FILE)
if [[ “$CURRENT_VAL” -eq -1 ]]; then
echo Setting connection value from -1 to 0.
echo 0 > $FILE
else
echo Current connection value of $CURRENT_VAL is not -1.
fi
else
echo $FILE does not exist to update.
exit 1
fi

Where Next?

Popular Pragmatic Bookshelf topics Top

johnp
Running the examples in chapter 5 c under pytest 5.4.1 causes an AttributeError: ‘module’ object has no attribute ‘config’. In particula...
New
jamis
The following is cross-posted from the original Ray Tracer Challenge forum, from a post by garfieldnate. I’m cross-posting it so that the...
New
JohnS
I can’t setup the Rails source code. This happens in a working directory containing multiple (postgres) Rails apps. With: ruby-3.0.0 s...
New
herminiotorres
Hi! I know not the intentions behind this narrative when called, on page XI: mount() |&gt; handle_event() |&gt; render() but the correc...
New
rainforest
Hi, I’ve got a question about the implementation of PubSub when using a Phoenix.Socket.Transport behaviour rather than channels. Before ...
New
dtonhofer
@parrt In the context of Chapter 4.3, the grammar Java.g4, meant to parse Java 6 compilation units, no longer passes ANTLR (currently 4....
New
redconfetti
Docker-Machine became part of the Docker Toolbox, which was deprecated in 2020, long after Docker Desktop supported Docker Engine nativel...
New
gorkaio
root_layout: {PentoWeb.LayoutView, :root}, This results in the following following error: no “root” html template defined for PentoWeb...
New
dachristenson
I just bought this book to learn about Android development, and I’m already running into a major issue in Ch. 1, p. 20: “Update activity...
New
dachristenson
I’ve got to the end of Ch. 11, and the app runs, with all tabs displaying what they should – at first. After switching around between St...
New

Other popular topics Top

Devtalk
Reading something? Working on something? Planning something? Changing jobs even!? If you’re up for sharing, please let us know what you’...
1063 23050 405
New
PragmaticBookshelf
Take your Go skills to the next level by learning how to design, develop, and deploy a distributed service. Start from the bare essential...
New
AstonJ
This looks like a stunning keycap set :orange_heart: A LEGENDARY KEYBOARD LIVES ON When you bought an Apple Macintosh computer in the e...
New
Exadra37
Oh just spent so much time on this to discover now that RancherOS is in end of life but Rancher is refusing to mark the Github repo as su...
New
PragmaticBookshelf
Build highly interactive applications without ever leaving Elixir, the way the experts do. Let LiveView take care of performance, scalabi...
New
AstonJ
Continuing the discussion from Thinking about learning Crystal, let’s discuss - I was wondering which languages don’t GC - maybe we can c...
New
mafinar
This is going to be a long an frequently posted thread. While talking to a friend of mine who has taken data structure and algorithm cou...
New
PragmaticBookshelf
Author Spotlight Mike Riley @mriley This month, we turn the spotlight on Mike Riley, author of Portable Python Projects. Mike’s book ...
New
PragmaticBookshelf
Author Spotlight: VM Brasseur @vmbrasseur We have a treat for you today! We turn the spotlight onto Open Source as we sit down with V...
New
PragmaticBookshelf
Use advanced functional programming principles, practical Domain-Driven Design techniques, and production-ready Elixir code to build scal...
New

Sub Categories: