kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Distributed Services With Go - Agent_test.go error line 77

This test is broken right out of the box… — FAIL: TestAgent (7.82s) agent_test.go:77: Error Trace: agent_test.go:77 agent_test.go:...

#errata /book-distributed-services-with-go

4 1559 7

2020-06-26 06:50:51 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition: migrations/create not working: p159

Title: Web Development with Clojure, Third Edition - migrations/create not working: p159 When I execute the command: user=> (create-...

#question /book-web-development-with-clojure-third-edition

5 1084 2

2020-11-14 22:24:32 UTC

New

PragProg Customers

Hands-on Rust: Build depending on bracket-lib fails

Hi, build fails on: bracket-lib = “~0.8.1” when running on Mac Mini M1 Rust version 1.5.0: Compiling winit v0.22.2 error[E0308]: mi...

#question /book-hands-on-rust

1 1218 1

2021-02-14 14:34:19 UTC

New

PragProg Customers

Programming Kotlin: Difference between SupervisorJob() and supervisorScope (324, 325)

Hi @venkats, It has been mentioned in the description of ‘Supervisory Job’ title that 2 things as mentioned below result in the same eff...

#question /book-programming-kotlin

0 2242 2

2021-03-16 11:28:51 UTC

New

PragProg Customers

Programming Phoenix LiveView: P27, live_path confusion

I am working on the “Your Turn” for chapter one and building out the restart button talked about on page 27. It recommends looking into ...

#question /book-programming-phoenix-liveview

7 3505 14

2023-08-09 13:36:28 UTC

New

PragProg Customers

Build a Weather Station with Elixir and Nerves: SGP30 vs SGP40

This is as much a suggestion as a question, as a note for others. Locally the SGP30 wasn’t available, so I ordered a SGP40. On page 53, ...

#suggestion /book-build-a-weather-station-with-elixir-and-nerves

0 1292 2

2024-03-20 19:56:42 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: Error in generated Game.java (page 136)

I’m under the impression that when the reader gets to page 136 (“View Data with the Database Inspector”), the code SHOULD be able to buil...

#question /book-kotlin-and-android-development-featuring-jetpack

2 1172 8

2021-09-17 18:06:54 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: InterpreterNotFound error when running tox (page 150)

When running tox for the first time, I got the following error: ERROR: InterpreterNotFound: python3.10 I realised that I was running ...

#errata /book-python-testing-with-pytest-second-edition

0 1306 1

2021-12-10 05:06:56 UTC

New

PragProg Customers

Programming Machine Learning: Setting up your system (p 13)

From page 13: On Python 3.7, you can install the libraries with pip by running these commands inside a Python venv using Visual Studio ...

#question /book-programming-machine-learning

1 989 3

2023-10-09 07:44:15 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: End Ch. 11 app runs but consistently crashes

I’ve got to the end of Ch. 11, and the app runs, with all tabs displaying what they should – at first. After switching around between St...

#question /book-kotlin-and-android-development-featuring-jetpack

0 936 8

2024-01-05 05:43:55 UTC

New

Other popular topics

General Dev>Dev Chat

What are you listening to?

A thread that every forum needs! Simply post a link to a track on YouTube (or SoundCloud or Vimeo amongst others!) on a separate line an...

#community #music

202 5126 102

2025-07-26 22:00:31 UTC

New

Game Dev>Learning Resources

The Ray Tracer Challenge

Brace yourself for a fun challenge: build a photorealistic 3D renderer from scratch! In just a couple of weeks, build a ray tracer that r...

pragprog.com

#pragprog #published-book /book-the-ray-tracer-challenge #algorithms

3 6115 0

2020-09-22 14:26:56 UTC

New

General Dev>Dev Chat

Which language or framework do you want to learn next?

Curious to know which languages and frameworks you’re all thinking about learning next :upside_down_face: Perhaps if there’s enough peop...

#community #learning

243 6639 97

2025-12-01 07:17:12 UTC

New

Backend>Chat

How to install Ruby 3 with ASDF

In case anyone else is wondering why Ruby 3 doesn’t show when you do asdf list-all ruby :man_facepalming: do this first: asdf plugin-upd...

/ruby #asdf

11 5961 4

2021-02-02 08:02:13 UTC

New

General Dev>Dev Chat

Warp—The blazingly fast, Rust-based terminal

A few weeks ago I started using Warp a terminal written in rust. Though in it’s current state of development there are a few caveats (tab...

/rust #terminal

52 6785 22

2025-02-26 17:47:24 UTC

New

Backend>Chat

Data Structures and Algorithms with Elixir

This is going to be a long an frequently posted thread. While talking to a friend of mine who has taken data structure and algorithm cou...

/elixir #algorithms #data-structures

108 11869 31

2024-11-14 02:14:00 UTC

New

Frontend>Chat

Online Hand to eye coordination test

Was just curious to see if any were around, found this one: I got 51/100: Not sure if it was meant to buy I am sure at times the b...

#online-tools

4 4562 1

2022-03-27 10:53:45 UTC

New

Community>In The Spotlight

Spotlight: Bruce Tate (Author) Interview and AMA!

Author Spotlight: Bruce Tate @redrapids Programming languages always emerge out of need, and if that’s not always true, they’re defin...

/elixir /ruby /phoenix /book-seven-more-languages-in-seven-weeks /book-seven-languages-in-seven-weeks #liveview /book-programming-phoenix-liveview

54 5678 23

2023-10-17 17:14:03 UTC

New

General Dev>In The News

Review of Linux on Minisforum V3 AMD Ryzen Tablet

A Brief Review of the Minisforum V3 AMD Tablet. Update: I have created an awesome-minisforum-v3 GitHub repository to list information fo...

mudkip.me

#linux #review #amd

0 4635 0

2024-06-24 02:26:38 UTC

New

AI>In The News

DeepSeek (671B) running on a cluster of 8 Mac Mini Pros with 64GB RAM each

This is cool! DEEPSEEK-V3 ON M4 MAC: BLAZING FAST INFERENCE ON APPLE SILICON We just witnessed something incredible: the largest open-s...

#ai #macs /deepseek

0 6695 1

2025-01-29 18:43:37 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Distributed Services With Go - Agent_test.go error line 77

Web Development with Clojure, Third Edition: migrations/create not working: p159

Hands-on Rust: Build depending on bracket-lib fails

Programming Kotlin: Difference between SupervisorJob() and supervisorScope (324, 325)

Programming Phoenix LiveView: P27, live_path confusion

Build a Weather Station with Elixir and Nerves: SGP30 vs SGP40

Kotlin and Android Development featuring Jetpack: Error in generated Game.java (page 136)

Python Testing with pytest, Second Edition: InterpreterNotFound error when running tox (page 150)

Programming Machine Learning: Setting up your system (p 13)

Kotlin and Android Development featuring Jetpack: End Ch. 11 app runs but consistently crashes