kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Programming Machine Learning: Incorrect formula

Hi everyone! There is an error on the page 71 in the book “Programming machine learning from coding to depp learning” P. Perrotta. You c...

#errata /book-programming-machine-learning

5 1341 4

2022-04-06 12:03:54 UTC

New

PragProg Customers

Hands-on Rust: question about get_component

Title: Hands-on Rust: question about get_component (page 295) (feel free to respond. “You dug you’re own hole… good luck”) I have somet...

#question /book-hands-on-rust

1 1167 5

2021-02-01 15:17:34 UTC

New

PragProg Customers

Programming Phoenix LiveView: Typo

Hi! I know not the intentions behind this narrative when called, on page XI: mount() |> handle_event() |> render() but the correc...

#errata /book-programming-phoenix-liveview

3 1307 17

2021-03-11 16:34:20 UTC

New

PragProg Customers

Intuitive Python: docker run… denied error (page 2)

Title: Intuitive Python: docker run… denied error (page 2) Attempted to run the docker command in both CLI and Powershell PS C:\Users\r...

#errata /book-intuitive-python

9 1263 4

2021-04-06 16:33:24 UTC

New

PragProg Customers

Programming Phoenix LiveView: B03 (page 56-57) auth exercise

Dear Sophie. I tried to do the “Authorization” exercise and have two questions: When trying to plug in an email-service, I found the ...

#question /book-programming-phoenix-liveview

1 1181 3

2021-05-04 15:14:02 UTC

New

PragProg Customers

Build a Weather Station with Elixir and Nerves: SGP30 vs SGP40

This is as much a suggestion as a question, as a note for others. Locally the SGP30 wasn’t available, so I ordered a SGP40. On page 53, ...

#suggestion /book-build-a-weather-station-with-elixir-and-nerves

0 1292 2

2024-03-20 19:56:42 UTC

New

PragProg Customers

Hands-on Rust: Failed to Load Texture error (page 121)

Hi, I completed chapter 6 but am getting the following error when running: thread 'main' panicked at 'Failed to load texture: IoError(O...

/book-hands-on-rust

2 1310 3

2022-01-23 22:36:50 UTC

New

PragProg Customers

Agile Web Development with Rails 7: Example code does not work delete method (page 78)

On page 78 the following code appears: <%= link_to ‘Destroy’, product, class: ‘hover:underline’, method: :delete, data: { confirm...

#suggestion /book-agile-web-development-with-rails-7

1 1266 2

2022-01-29 08:01:09 UTC

New

PragProg Customers

Real-Time Phoenix: ProductChannelTest - undefined function describe/2 (pg 203)

Hi, I am getting an error I cannot figure out on my test. I have what I think is the exact code from the book, other than I changed “us...

#question /book-real-time-phoenix

0 1775 6

2022-02-16 19:15:15 UTC

New

PragProg Customers

Docker for Rails Developers - 'docker-machine' command deprecated (page 156)

Docker-Machine became part of the Docker Toolbox, which was deprecated in 2020, long after Docker Desktop supported Docker Engine nativel...

/book-docker-for-rails-developers #suggestion

0 896 0

2023-03-06 18:01:33 UTC

New

Other popular topics

General Dev>Dev Chat

What dev-related stuff have you been up to?

Reading something? Working on something? Planning something? Changing jobs even!? If you’re up for sharing, please let us know what you’...

#community

1050 21151 394

2026-01-01 02:02:13 UTC

New

General Dev>Hardware

Which keyboard do you have?

If it’s a mechanical keyboard, which switches do you have? Would you recommend it? Why? What will your next keyboard be? Pics always w...

#hardware /keyboards #sticky #mechanical-keyboards

144 9115 50

2021-01-07 23:58:36 UTC

New

General Dev>Hardware

BIIP MT3 Extended 2048 Custom Keycap Set (Drop)

This looks like a stunning keycap set :orange_heart: A LEGENDARY KEYBOARD LIVES ON When you bought an Apple Macintosh computer in the e...

/keyboards #apple #keycaps #mechanical-keyboards

14 6713 7

2020-12-12 19:58:26 UTC

New

macOS>Chat

My thoughts on macOS vs Linux

Small essay with thoughts on macOS vs. Linux: I know @Exadra37 is just waiting around the corner to scream at me “I TOLD YOU SO!!!” but I...

#macos #linux

166 9730 69

2021-04-10 22:36:29 UTC

New

General Dev>Dev Chat

The V Programming Language

The V Programming Language Simple language for building maintainable programs V is already mentioned couple of times in the forum, but I...

#programminguages /v

21 13874 7

2021-04-12 15:13:42 UTC

New

General Dev>Dev Chat

PragProg’s Medium Posts

Hello everyone! This thread is to tell you about what authors from The Pragmatic Bookshelf are writing on Medium.

#pragprog #blog-post

1147 29994 760

2025-07-10 13:36:16 UTC

New

Backend>Chat

Using Regular Expressions in Erlang

Intensively researching Erlang books and additional resources on it, I have found that the topic of using Regular Expressions is either c...

/erlang #regular-expressions

91 5662 43

2021-09-06 19:12:48 UTC

New

Backend>Learning Resources

Effective Haskell

Build efficient applications that exploit the unique benefits of a pure functional language, learning from an engineer who uses Haskell t...

pragprog.com

#pragprog /haskell #published-book /book-effective-haskell

15 10218 1

2022-02-16 10:09:51 UTC

New

Android>Questions

Clipboard readtext not working in android webview

Inside our android webview app, we are trying to paste the copied content from another app eg (notes) using navigator.clipboard.readtext ...

#android #clipboard

1 5651 0

2022-09-27 18:52:03 UTC

New

Backend>Learning Resources

Engineering Elixir Applications

Develop, deploy, and debug BEAM applications using BEAMOps: a new paradigm that focuses on scalability, fault tolerance, and owning each ...

pragprog.com

#pragprog /elixir #published-book /book-engineering-elixir-applications

40 7136 21

2024-11-08 15:13:02 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Programming Machine Learning: Incorrect formula