kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

The Pragmatic Programmer, 20th Anniversary Edition errata

Some minor things in the paper edition that says “3 2020” on the title page verso, not mentioned in the book’s errata online: p. 186 But...

#errata /book-the-pragmatic-programmer-20th-anniversary-edition

10 2636 9

2024-09-02 13:34:40 UTC

New

PragProg Customers

Hands-on Rust: can_place logic is "inside out"

Title: Hands-On Rust (Chapter 11: prefab) Just played a couple of amulet-less games. With a bit of debugging, I believe that your can_p...

#errata /book-hands-on-rust

22 1628 20

2022-03-29 12:23:50 UTC

New

PragProg Customers

Docker for Rails Developers: Notes for Rails 6.1, Ruby 2.7.2

I thought that there might be interest in using the book with Rails 6.1 and Ruby 2.7.2. I’ll note what I needed to do differently here. ...

/book-docker-for-rails-developers

9 1177 1

2021-01-03 20:41:43 UTC

New

PragProg Customers

Programming Kotlin: Difference between SupervisorJob() and supervisorScope (324, 325)

Hi @venkats, It has been mentioned in the description of ‘Supervisory Job’ title that 2 things as mentioned below result in the same eff...

#question /book-programming-kotlin

0 2242 2

2021-03-16 11:28:51 UTC

New

PragProg Customers

Programming Phoenix LiveView: errata and remarks Version B2.0

The generated iex result below should list products instead of product for the metadata. (page 67) iex> product = %Product{} %Pento....

#errata /book-programming-phoenix-liveview

0 1800 20

2021-03-23 10:33:03 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: File not Found Error (page 43)

I ran this command after installing the sample application: $ cards add do something --owner Brian And got a file not found error: Fil...

#errata /book-python-testing-with-pytest-second-edition

5 4391 7

2021-07-03 13:51:08 UTC

New

PragProg Customers

Modern Front-End Development for Rails: ERROR in tsconfig.json Chapter_01/01

@noelrappin Running the webpack dev server, I receive the following warning: ERROR in tsconfig.json TS18003: No inputs were found in c...

/book-modern-front-end-development-for-rails

3 1438 3

2021-09-02 19:11:59 UTC

New

PragProg Customers

The Ray Tracer Challenge: cannot pass scaling test (page 69-70)

The test is as follows: Scenario: Intersecting a scaled sphere with a ray Given r ← ray(point(0, 0, -5), vector(0, 0, 1)) And s ← sphere...

#question /book-the-ray-tracer-challenge

1 1093 4

2022-07-27 09:47:44 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: android:tint vs app:tint (chapter 7, p186)

I found an issue in Chapter 7 regarding android:backgroundTint vs app:backgroundTint. How to replicate: load chapter-7 from zipfile i...

#errata /book-kotlin-and-android-development-featuring-jetpack

0 3566 3

2022-04-26 09:10:52 UTC

New

PragProg Customers

Modern Front-End Development for Rails - application does not start after run bin/setup (page xviii)

After some hassle, I was able to finally run bin/setup, now I have started the rails server but I get this error message right when I vis...

#errata /book-modern-front-end-development-for-rails

0 1461 5

2022-06-03 09:50:10 UTC

New

Other popular topics

Backend>Learning Resources

Seven Languages in Seven Weeks

Ruby, Io, Prolog, Scala, Erlang, Clojure, Haskell. With Seven Languages in Seven Weeks, by Bruce A. Tate, you’ll go beyond the syntax—and...

pragprog.com

#pragprog /clojure /erlang /haskell /prolog /ruby /scala #published-book /book-seven-languages-in-seven-weeks

5 5730 1

2022-01-20 13:48:55 UTC

New

General Dev>Dev Chat

Which vertical monitor do you use?

I’m thinking of buying a monitor that I can rotate to use as a vertical monitor? Also, I want to know if someone is using it for program...

#monitors #programming

51 4892 20

2023-06-28 07:23:42 UTC

New

General Dev>Hardware

Planck vs Preonic vs Subatomic (Keyboards)

I ended up cancelling my Moonlander order as I think it’s just going to be a bit too bulky for me. I think the Planck and the Preonic (o...

/keyboards #mechanical-keyboards #ortholinear #planck #preonic

105 17596 47

2021-05-28 21:32:35 UTC

New

General Dev>Hardware

GMK Serika Keycaps - Serika 2 available to order now!

I have seen the keycaps I want - they are due for a group-buy this week but won’t be delivered until October next year!!! :rofl: The Ser...

/keyboards #keycaps #mechanical-keyboards

9 5097 7

2020-12-05 21:32:30 UTC

New

Backend>Chat

Using Regular Expressions in Erlang

Intensively researching Erlang books and additional resources on it, I have found that the topic of using Regular Expressions is either c...

/erlang #regular-expressions

91 5662 43

2021-09-06 19:12:48 UTC

New

Data Science

Can AI/ML predict a lottery win?

Biggest jackpot ever apparently! :upside_down_face: I don’t (usually) gamble/play the lottery, but working on a program to predict the...

#ai #machine-learning

19 3939 10

2021-10-18 19:01:41 UTC

New

Science/Tech>Health & Diet

David Sinclair's new Lifespan podcast

We’ve talked about his book briefly here but it is quickly becoming obsolete - so he’s decided to create a series of 7 podcasts, the firs...

#health #podcasts #bio-hackers #david-sinclair

87 6790 49

2022-04-12 16:27:36 UTC

New

Backend>Learning Resources

Effective Haskell

Build efficient applications that exploit the unique benefits of a pure functional language, learning from an engineer who uses Haskell t...

pragprog.com

#pragprog /haskell #published-book /book-effective-haskell

15 10218 1

2022-02-16 10:09:51 UTC

New

General Dev>In The News

Jan: An open source alternative to ChatGPT that runs on the desktop

Jan | Rethink the Computer. Jan turns your computer into an AI machine by running LLMs locally on your computer. It’s a privacy-focus, l...

jan.ai

#desktop #chatgpt

4 5652 4

2024-03-29 08:42:30 UTC

New

AI>In The News

DeepSeek (671B) running on a cluster of 8 Mac Mini Pros with 64GB RAM each

This is cool! DEEPSEEK-V3 ON M4 MAC: BLAZING FAST INFERENCE ON APPLE SILICON We just witnessed something incredible: the largest open-s...

#ai #macs /deepseek

0 6695 1

2025-01-29 18:43:37 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

The Pragmatic Programmer, 20th Anniversary Edition errata

Hands-on Rust: can_place logic is "inside out"

Docker for Rails Developers: Notes for Rails 6.1, Ruby 2.7.2

Programming Kotlin: Difference between SupervisorJob() and supervisorScope (324, 325)

Programming Phoenix LiveView: errata and remarks Version B2.0

Python Testing with pytest, Second Edition: File not Found Error (page 43)

Modern Front-End Development for Rails: ERROR in tsconfig.json Chapter_01/01

The Ray Tracer Challenge: cannot pass scaling test (page 69-70)

Kotlin and Android Development featuring Jetpack: android:tint vs app:tint (chapter 7, p186)

Modern Front-End Development for Rails - application does not start after run bin/setup (page xviii)