kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Modern CSS with Tailwind: can’t setup the Rails source code

I can’t setup the Rails source code. This happens in a working directory containing multiple (postgres) Rails apps. With: ruby-3.0.0 s...

#question /book-modern-css-with-tailwind

0 1280 3

2021-03-27 15:29:34 UTC

New

PragProg Customers

A Common-Sense Guide to Data Structures and Algorithms, Second Edition: erroneous extra space complexity (page400)

A Common-Sense Guide to Data Structures and Algorithms, Second Edition by Jay Wengrow @jaywengrow Hi, I have the paperback version of t...

#errata /book-a-common-sense-guide-to-data-structures-and-algorithms-second-edition

4 1180 2

2021-07-27 21:37:42 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition:Abou epub format

Is the book’s epub format available to read on Google Play Books?

#question /book-python-testing-with-pytest-second-edition

0 1126 3

2022-01-20 20:47:42 UTC

New

PragProg Customers

Hands-on Rust: Failed to Load Texture error (page 121)

Hi, I completed chapter 6 but am getting the following error when running: thread 'main' panicked at 'Failed to load texture: IoError(O...

/book-hands-on-rust

2 1310 3

2022-01-23 22:36:50 UTC

New

PragProg Customers

Real-Time Phoenix: ProductChannelTest - undefined function describe/2 (pg 203)

Hi, I am getting an error I cannot figure out on my test. I have what I think is the exact code from the book, other than I changed “us...

#question /book-real-time-phoenix

0 1775 6

2022-02-16 19:15:15 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: allprojects should be moved to settings.gradle (page 245)

The allprojects block listed on page 245 produces the following error when syncing gradle: “org.gradle.api.GradleScriptException: A prob...

#suggestion /book-kotlin-and-android-development-featuring-jetpack

1 2304 1

2022-02-26 23:52:12 UTC

New

PragProg Customers

Programming Phoenix LiveView: Live Upload Match Error

Book: Programming Phoenix LiveView, page 142 (157/378), file lib/pento_web/live/product_live/form_component.ex, in the function below: d...

#errata /book-programming-phoenix-liveview

7 1158 10

2023-01-26 13:23:12 UTC

New

PragProg Customers

Modern Front-End Development for Rails - application does not start after run bin/setup (page xviii)

After some hassle, I was able to finally run bin/setup, now I have started the rails server but I get this error message right when I vis...

#errata /book-modern-front-end-development-for-rails

0 1461 5

2022-06-03 09:50:10 UTC

New

PragProg Customers

The Definitive ANTLR 4 Reference - "Java.g4" grammer (used on page 40) no longer passes ANTLR

@parrt In the context of Chapter 4.3, the grammar Java.g4, meant to parse Java 6 compilation units, no longer passes ANTLR (currently 4....

#errata /book-the-definitive-antlr-4-reference

0 1020 3

2023-02-14 01:34:49 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: Transformations class doesn't seem to exist anymore (pp. 140-141

@mfazio23 Android Studio will not accept anything I do when trying to use the Transformations class, as described on pp. 140-141. Googl...

#errata /book-kotlin-and-android-development-featuring-jetpack

0 2155 5

2023-10-01 15:02:47 UTC

New

Other popular topics

Backend>Questions

Erlang's not installing on macOS Big Sur "You are natively building Erlang/OTP for a later version of MacOSX than current version"

Just done a fresh install of macOS Big Sur and on installing Erlang I am getting: asdf install erlang 23.1.2 Configure failed. checking ...

#macos /erlang #big-sur #asdf

10 6212 8

2021-01-16 12:33:23 UTC

New

Science/Tech>Health & Diet

David Sinclair's new Lifespan podcast

We’ve talked about his book briefly here but it is quickly becoming obsolete - so he’s decided to create a series of 7 podcasts, the firs...

#health #podcasts #bio-hackers #david-sinclair

87 6790 49

2022-04-12 16:27:36 UTC

New

General Dev>Code Editors

Doom-Emacs: Can't find emacs in your PATH

If you get Can't find emacs in your PATH when trying to install Doom Emacs on your Mac you… just… need to install Emacs first! :lol: bre...

#macos /emacs #doom-emacs

4 5837 0

2022-02-04 00:32:03 UTC

New

Community>In The Spotlight

Spotlight: Jamis Buck (Author) Interview and AMA!

Author Spotlight Jamis Buck @jamis This month, we have the pleasure of spotlighting author Jamis Buck, who has written Mazes for Prog...

#author-spotlight /ruby /book-the-ray-tracer-challenge /book-mazes-for-programmers

21 6352 9

2022-09-28 18:21:15 UTC

New

Backend>Learning Resources

Programming Ruby 3.2 (5th Edition)

Programming Ruby is the most complete book on Ruby, covering both the language itself and the standard library as well as commonly used t...

twitter.com

#pragprog /ruby /rails #published-book /book-programming-ruby-3-2-5th-edition

28 8550 13

2024-11-17 04:34:14 UTC

New

Windows>Chat

Taskbar Overflow Menu (NOT System Tray Overflow)

There appears to have been an update that has changed the terminology for what has previously been known as the Taskbar Overflow - this h...

#taskbar-overflow-win-11

3 3715 2

2023-02-13 08:43:55 UTC

New

Backend>Learning Resources

Engineering Elixir Applications

Develop, deploy, and debug BEAM applications using BEAMOps: a new paradigm that focuses on scalability, fault tolerance, and owning each ...

pragprog.com

#pragprog /elixir #published-book /book-engineering-elixir-applications

40 7136 21

2024-11-08 15:13:02 UTC

New

AI>Chat

How to: Run DeepSeek on Mac, Windows, and Linux!

This is a very quick guide, you just need to: Download LM Studio: https://lmstudio.ai/ Click on search Type DeepSeek, then select the o...

#macs /deepseek #guides #lm-studio

14 9328 10

2025-06-19 15:11:16 UTC

New

Game Dev>Chat

Hair Salon Games for Girls Fun

Hair Salon Games for Girls Fun Girls Hair Saloon game is mainly developed for kids. This game allows users to select virtual avatars to ...

#ios #android #unity #fun

2 3556 1

2025-02-27 10:48:33 UTC

New

AI>Questions

What are the best text-to-speech ai generation tools that you can run locally?

Background Lately I am in a quest to find a good quality TTS ai generation tool to run locally in order to create audio for some videos I...

#ai #text-to-speech

6 8411 3

2025-03-24 16:48:39 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Modern CSS with Tailwind: can’t setup the Rails source code

A Common-Sense Guide to Data Structures and Algorithms, Second Edition: erroneous extra space complexity (page400)

Python Testing with pytest, Second Edition:Abou epub format

Hands-on Rust: Failed to Load Texture error (page 121)

Real-Time Phoenix: ProductChannelTest - undefined function describe/2 (pg 203)

Kotlin and Android Development featuring Jetpack: allprojects should be moved to settings.gradle (page 245)

Programming Phoenix LiveView: Live Upload Match Error

Modern Front-End Development for Rails - application does not start after run bin/setup (page xviii)

The Definitive ANTLR 4 Reference - "Java.g4" grammer (used on page 40) no longer passes ANTLR

Kotlin and Android Development featuring Jetpack: Transformations class doesn't seem to exist anymore (pp. 140-141

Other popular topics