kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 549 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 549 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Apple Game Frameworks and Technologies: Screen image may be wrong (p 13)

Working through the steps (checking that the Info,plist matches exactly), run the demo game and what appears is grey but does not fill th...

#errata /book-apple-game-frameworks-and-technologies

11 1081 5

2021-05-15 17:31:07 UTC

New

PragProg Customers

Programming Machine Learning: Incorrect formula

Hi everyone! There is an error on the page 71 in the book “Programming machine learning from coding to depp learning” P. Perrotta. You c...

#errata /book-programming-machine-learning

5 1335 4

2022-04-06 12:03:54 UTC

New

PragProg Customers

Distributed Services with Go: Chapter 3 suggestions

Page 28: It implements io.ReaderAt on the store type. Sorry if it’s a dumb question but was the io.ReaderAt supposed to be io.ReadAt? ...

#errata /book-distributed-services-with-go

0 1297 3

2022-07-27 14:35:18 UTC

New

PragProg Customers

Modern CSS with Tailwind: setting up Rails app

In case this helps anyone, I’ve had issues setting up the rails source code. Here were the solutions: In Gemfile, change gem 'rails' t...

#errata /book-modern-css-with-tailwind

3 1276 2

2022-01-05 00:19:21 UTC

New

PragProg Customers

Programming Phoenix LiveView: B03 (page 56-57) auth exercise

Dear Sophie. I tried to do the “Authorization” exercise and have two questions: When trying to plug in an email-service, I found the ...

#question /book-programming-phoenix-liveview

1 1180 3

2021-05-04 15:14:02 UTC

New

PragProg Customers

Build a Weather Station with Elixir and Nerves: 'mix deps.get' does not work if user has not created a keyfile (page 16)

Running mix deps.get in the sensor_hub directory fails with the following error: ** (Mix) No SSH public keys found in ~/.ssh. An ssh aut...

#errata /book-build-a-weather-station-with-elixir-and-nerves

2 1449 3

2024-12-18 18:02:25 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: Error in generated Game.java (page 136)

I’m under the impression that when the reader gets to page 136 (“View Data with the Database Inspector”), the code SHOULD be able to buil...

#question /book-kotlin-and-android-development-featuring-jetpack

2 1166 8

2021-09-17 18:06:54 UTC

New

PragProg Customers

The Ray Tracer Challenge: cannot pass scaling test (page 69-70)

The test is as follows: Scenario: Intersecting a scaled sphere with a ray Given r ← ray(point(0, 0, -5), vector(0, 0, 1)) And s ← sphere...

#question /book-the-ray-tracer-challenge

1 1085 4

2022-07-27 09:47:44 UTC

New

PragProg Customers

Hands on Rust: Need help with error - thread 'main' panicked at 'Failed to load texture

Hi, I need some help, I’m new to rust and was learning through your book. but I got stuck at the last stage of distribution. Whenever I t...

#question /book-hands-on-rust

3 1979 5

2022-12-03 00:17:31 UTC

New

PragProg Customers

The Ray Tracer Challenge: Cannot get rid of acne When implement Shadows in Chapter 8.

Hi, I’m working on the Chapter 8 of the book. After I add add the point_offset, I’m still able to see acne: In the image above, I re...

#question /book-the-ray-tracer-challenge

1 1033 4

2024-07-09 23:10:34 UTC

New

Other popular topics

General Dev>Dev Chat

What dev-related stuff have you been up to?

Reading something? Working on something? Planning something? Changing jobs even!? If you’re up for sharing, please let us know what you’...

#community

1045 20596 392

2025-11-22 01:47:30 UTC

New

General Dev>Dev Chat

Which language or framework do you want to learn next?

Curious to know which languages and frameworks you’re all thinking about learning next :upside_down_face: Perhaps if there’s enough peop...

#community #learning

243 6417 96

2025-11-29 05:01:56 UTC

New

Backend>In The News

Bit – A modernized Git CLI written in Go

github.com

/go #git

1 5741 0

2020-10-12 18:31:12 UTC

New

General Dev>Code Editors

Onivim 2 Code Editor

Thanks to @foxtrottwist’s and @Tomas’s posts in this thread: Poll: Which code editor do you use? I bought Onivim! :nerd_face: https://on...

#code-editors /onivim /revery

88 5821 32

2023-05-15 07:32:26 UTC

New

Backend>Learning Resources

Concurrent Data Processing in Elixir

Learn different ways of writing concurrent code in Elixir and increase your application's performance, without sacrificing scalability or...

pragprog.com

#pragprog /elixir #published-book /book-concurrent-data-processing-in-elixir

78 5131 24

2021-09-04 12:35:42 UTC

New

General Dev>Dev Chat

Warp—The blazingly fast, Rust-based terminal

A few weeks ago I started using Warp a terminal written in rust. Though in it’s current state of development there are a few caveats (tab...

/rust #terminal

52 5824 22

2025-02-26 17:47:24 UTC

New

Community>In The Spotlight

Spotlight: Dmitry Zinoviev (Author) Interview and AMA!

Author Spotlight Dmitry Zinoviev @aqsaqal Today we’re putting our spotlight on Dmitry Zinoviev, author of Data Science Essentials in ...

#author-spotlight /python /book-complex-network-analysis-in-python /book-data-science-essentials-in-python /book-resourceful-code-reuse /book-pythonic-programming

33 5041 14

2022-10-11 20:07:10 UTC

New

Game Dev>Questions

Can I use Java to program a game for Nintendo switch?

I am trying to crate a game for the Nintendo switch, I wanted to use Java as I am comfortable with that programming language. Can you use...

/java #nintendo

8 3968 3

2023-09-15 11:15:04 UTC

New

macOS>Chat

How to block any website on Mac using Little Snitch

If you want a quick and easy way to block any website on your Mac using Little Snitch simply… File > New Rule: And select Deny, O...

#macos #how-to #littlesnitch

5 9782 3

2022-07-05 00:59:40 UTC

New

General Dev>Questions

Do you prefer regular mechanical keyboards or low profile mechanical keyboards and why?

I have always used antique keyboards like Cherry MX 1800 or Cherry MX 8100 and almost always have modified the switches in some way, like...

/keyboards #mechanical-keyboards

27 3339 9

2023-02-06 21:10:15 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Apple Game Frameworks and Technologies: Screen image may be wrong (p 13)

Programming Machine Learning: Incorrect formula

Distributed Services with Go: Chapter 3 suggestions

Modern CSS with Tailwind: setting up Rails app

Programming Phoenix LiveView: B03 (page 56-57) auth exercise

Build a Weather Station with Elixir and Nerves: 'mix deps.get' does not work if user has not created a keyfile (page 16)

Kotlin and Android Development featuring Jetpack: Error in generated Game.java (page 136)

The Ray Tracer Challenge: cannot pass scaling test (page 69-70)

Hands on Rust: Need help with error - thread 'main' panicked at 'Failed to load texture

The Ray Tracer Challenge: Cannot get rid of acne When implement Shadows in Chapter 8.

Other popular topics

What dev-related stuff have you been up to?