kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 549 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 549 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Hands-On Rust: Wrong multiplier for 8x8 console in main.rs

Title: Hands-On Rust (Chap 8 (Adding a Heads Up Display) It looks like .with_simple_console_no_bg(SCREEN_WIDTH*2, SCREEN_HEIGHT*2...

#errata /book-hands-on-rust

9 2015 5

2022-02-15 14:09:12 UTC

New

PragProg Customers

Build a Weather Station with Elixir and Nerves: SGP30 vs SGP40

This is as much a suggestion as a question, as a note for others. Locally the SGP30 wasn’t available, so I ordered a SGP40. On page 53, ...

#suggestion /book-build-a-weather-station-with-elixir-and-nerves

0 1288 2

2024-03-20 19:56:42 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: unrecognized arguments error (page 122)

When I run the coverage example to report on missing lines, I get: pytest --cov=cards --report=term-missing ch7 ERROR: usage: pytest [op...

#errata /book-python-testing-with-pytest-second-edition

0 3982 1

2021-12-03 05:36:38 UTC

New

PragProg Customers

Hands-on Rust: Failed to Load Texture error (page 121)

Hi, I completed chapter 6 but am getting the following error when running: thread 'main' panicked at 'Failed to load texture: IoError(O...

/book-hands-on-rust

2 1305 3

2022-01-23 22:36:50 UTC

New

PragProg Customers

Agile Web Development with Rails 7: (page 70)

Title: Agile Web Development with Rails 7: (page 70) I am running windows 11 pro with rails 7.0.3 and ruby 3.1.2p20 (2022-04-12 revision...

#question /book-agile-web-development-with-rails-7

0 1127 1

2022-06-08 13:17:16 UTC

New

PragProg Customers

PragProg Customers Kotlin and Android Development: pg. 8 Build Gradle error: Could not get unknown property 'kotlin_version'

I am using Android Studio Chipmunk | 2021.2.1 Patch 2 Build #AI-212.5712.43.2112.8815526, built on July 10, 2022 Runtime version: 11.0....

#question /book-kotlin-and-android-development-featuring-jetpack

0 1424 2

2022-08-29 14:30:50 UTC

New

PragProg Customers

Programming Machine Learning: some plot files are throwing error

I got this error when executing the plot files on macOS Ventura 13.0.1 with Python 3.10.8 and matplotlib 3.6.1: programming_ML/code/03_...

#question /book-programming-machine-learning

1 3049 5

2023-09-17 09:42:29 UTC

New

PragProg Customers

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)

root_layout: {PentoWeb.LayoutView, :root}, This results in the following following error: no “root” html template defined for PentoWeb...

#errata /book-programming-phoenix-liveview

8 1090 4

2023-10-22 17:25:26 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: Unique constraint error when running chapter 5 code changes

@mfazio23 I’ve applied the changes from Chapter 5 of the book and everything builds correctly and runs. But, when I try to start a game,...

/book-kotlin-and-android-development-featuring-jetpack

0 1165 10

2023-08-07 20:43:16 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: End Ch. 11 app runs but consistently crashes

I’ve got to the end of Ch. 11, and the app runs, with all tabs displaying what they should – at first. After switching around between St...

#question /book-kotlin-and-android-development-featuring-jetpack

0 917 8

2024-01-05 05:43:55 UTC

New

Other popular topics

General Dev>Hardware

Which keyboard do you have?

If it’s a mechanical keyboard, which switches do you have? Would you recommend it? Why? What will your next keyboard be? Pics always w...

#hardware /keyboards #sticky #mechanical-keyboards

144 8820 50

2021-01-07 23:58:36 UTC

New

Science/Tech>Tech Chat

Games! Which do you play?

Which, if any, games do you play? On what platform? I just bought (and completed) Minecraft Dungeons for my Nintendo Switch. Other than ...

#games

246 5882 101

2024-08-22 11:09:29 UTC

New

Science/Tech>Health & Diet

How do you keep fit and healthy?

@AstonJ prompted me to open this topic after I mentioned in the lockdown thread how I started to do a lot more for my fitness. https://f...

#fitness #heath

193 4728 82

2023-01-23 06:00:46 UTC

New

General Dev>Hardware

What monitor(s) do you have for programming?

Please tell us what is your preferred monitor setup for programming(not gaming) and why you have chosen it. Does your monitor have eye p...

#monitors #coding #programming #development

227 10159 88

2022-02-01 12:02:08 UTC

New

General Dev>Hardware

Moonlander Keyboard (Mechanical) (Ergonomic) (Split) (Ortholinear)

Bought the Moonlander mechanical keyboard. Cherry Brown MX switches. Arms and wrists have been hurting enough that it’s time I did someth...

#hardware /keyboards #moonlander #mechanical-keyboards #ortholinear #ergonomic

212 16447 90

2021-07-13 15:33:55 UTC

New

Community>Journals

Programming Erlang Book Club

My first contact with Erlang was about 2 years ago when I used RabbitMQ, which is written in Erlang, for my job. This made me curious and...

/erlang /book-programming-erlang-2nd-edition #book-club

195 6634 95

2025-02-16 20:22:17 UTC

New

General Dev>Sales

Get 50% off these PragProg books during our Think Again Sale

Think Again 50% Off Sale » The theme of this sale is new perspectives on familiar topics. Enter coupon code ThinkAgain2021 at checkout t...

#community #pragprog /elixir /book-a-common-sense-guide-to-data-structures-and-algorithms-second-edition /book-programming-machine-learning /book-the-ray-tracer-challenge /book-forge-your-future-with-open-source /book-software-design-x-rays #algorithms /book-testing-elixir #machine-learning #sale /book-concurrent-data-processing-in-elixir /book-intuitive-python

8 6210 2

2021-05-11 23:06:15 UTC

New

Windows>Chat

Taskbar Overflow Menu (NOT System Tray Overflow)

There appears to have been an update that has changed the terminology for what has previously been known as the Taskbar Overflow - this h...

#taskbar-overflow-win-11

3 2694 2

2023-02-13 08:43:55 UTC

New

Game Dev>Questions

I want to learn how make a game, but where should I start?

I’m able to do the “artistic” part of game-development; character designing/modeling, music, environment modeling, etc. However, I don’t...

#game-dev

14 4122 9

2025-10-18 13:12:58 UTC

New

Backend>Learning Resources

MySQL 9 Essentials

A concise guide to MySQL 9 database administration, covering fundamental concepts, techniques, and best practices. Neil Smyth MySQL...

pragprog.com

#pragprog #published-book /mysql /book-mysql-9-essentials

2 2579 0

2025-03-12 13:05:49 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Hands-On Rust: Wrong multiplier for 8x8 console in main.rs

Build a Weather Station with Elixir and Nerves: SGP30 vs SGP40

Python Testing with pytest, Second Edition: unrecognized arguments error (page 122)

Hands-on Rust: Failed to Load Texture error (page 121)

Agile Web Development with Rails 7: (page 70)

PragProg Customers Kotlin and Android Development: pg. 8 Build Gradle error: Could not get unknown property 'kotlin_version'

Programming Machine Learning: some plot files are throwing error

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)

Kotlin and Android Development featuring Jetpack: Unique constraint error when running chapter 5 code changes

Kotlin and Android Development featuring Jetpack: End Ch. 11 app runs but consistently crashes