kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Distributed Services With Go - Agent_test.go error line 77

This test is broken right out of the box… — FAIL: TestAgent (7.82s) agent_test.go:77: Error Trace: agent_test.go:77 agent_test.go:...

#errata /book-distributed-services-with-go

4 1559 7

2020-06-26 06:50:51 UTC

New

PragProg Customers

Effective Testing with RSpec 3: Running Sequel migrations fails (page 84)

Following the steps described in Chapter 6 of the book, I’m stuck with running the migration as described on page 84: bundle exec sequel...

#errata /book-effective-testing-with-rspec-3

4 1152 1

2020-07-16 15:18:25 UTC

New

PragProg Customers

Hands-on Rust: can_place logic is "inside out"

Title: Hands-On Rust (Chapter 11: prefab) Just played a couple of amulet-less games. With a bit of debugging, I believe that your can_p...

#errata /book-hands-on-rust

22 1628 20

2022-03-29 12:23:50 UTC

New

PragProg Customers

The Ray Tracer Challenge: "Computing the normal on a transformed sphere" ebook test

Hi Jamis, I think there’s an issue with a test on chapter 6. I own the ebook, version P1.0 Feb. 2019. This test doesn’t pass for me: ...

#errata /book-the-ray-tracer-challenge

10 1461 5

2025-01-13 14:42:44 UTC

New

PragProg Customers

Hands-on Rust: question about get_component

Title: Hands-on Rust: question about get_component (page 295) (feel free to respond. “You dug you’re own hole… good luck”) I have somet...

#question /book-hands-on-rust

1 1167 5

2021-02-01 15:17:34 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition (vB17.0): create table syntax invalid

Title: Web Development with Clojure, Third Edition, vB17.0 (p9) The create table guestbook syntax suggested doesn’t seem to be accepted ...

#errata /book-web-development-with-clojure-third-edition

0 1835 1

2021-08-13 23:56:52 UTC

New

PragProg Customers

Build a Weather Station with Elixir and Nerves: SGP30 vs SGP40

This is as much a suggestion as a question, as a note for others. Locally the SGP30 wasn’t available, so I ordered a SGP40. On page 53, ...

#suggestion /book-build-a-weather-station-with-elixir-and-nerves

0 1292 2

2024-03-20 19:56:42 UTC

New

PragProg Customers

Build a Weather Station with Elixir and Nerves: Problem connecting to Postgres with Grafana

Title: Build a Weather Station with Elixir and Nerves: Problem connecting to Postgres with Grafana on (page 64) If you follow the defau...

#errata /book-build-a-weather-station-with-elixir-and-nerves

0 1962 4

2021-11-16 04:25:39 UTC

New

PragProg Customers

Real Time Phoenix Errata P17: Getting first sample working with Phoenix 1.6.x

Skimming ahead, much of the following is explained in Chapter 3, but new readers (like me!) will hit a roadblock in Chapter 2 with their ...

#errata /book-real-time-phoenix

6 1116 5

2022-12-08 12:49:23 UTC

New

PragProg Customers

Programming Machine Learning: Setting up your system (p 13)

From page 13: On Python 3.7, you can install the libraries with pip by running these commands inside a Python venv using Visual Studio ...

#question /book-programming-machine-learning

1 989 3

2023-10-09 07:44:15 UTC

New

Other popular topics

General Dev>Dev Chat

HELLO WORLD (Introductions thread!)

Hello Devtalk World! Please let us know a little about who you are and where you’re from :nerd_face:

#community

482 7161 117

2026-03-22 04:54:57 UTC

New

Backend>Learning Resources

Distributed Services with Go

Take your Go skills to the next level by learning how to design, develop, and deploy a distributed service. Start from the bare essential...

pragprog.com

#pragprog /go #published-book /book-distributed-services-with-go

1 4310 0

2020-04-14 19:05:22 UTC

New

Backend>Learning Resources

Seven Languages in Seven Weeks

Ruby, Io, Prolog, Scala, Erlang, Clojure, Haskell. With Seven Languages in Seven Weeks, by Bruce A. Tate, you’ll go beyond the syntax—and...

pragprog.com

#pragprog /clojure /erlang /haskell /prolog /ruby /scala #published-book /book-seven-languages-in-seven-weeks

5 5730 1

2022-01-20 13:48:55 UTC

New

Data Science

Genetic Algorithms in Elixir

From finance to artificial intelligence, genetic algorithms are a powerful tool with a wide array of applications. But you don't need an ...

#pragprog #ai /elixir #published-book /book-genetic-algorithms-in-elixir

25 5243 6

2021-02-09 12:32:09 UTC

New

macOS>Chat

My thoughts on macOS vs Linux

Small essay with thoughts on macOS vs. Linux: I know @Exadra37 is just waiting around the corner to scream at me “I TOLD YOU SO!!!” but I...

#macos #linux

166 9730 69

2021-04-10 22:36:29 UTC

New

General Dev>Code Editors

Doom-Emacs: Can't find emacs in your PATH

If you get Can't find emacs in your PATH when trying to install Doom Emacs on your Mac you… just… need to install Emacs first! :lol: bre...

#macos /emacs #doom-emacs

4 5837 0

2022-02-04 00:32:03 UTC

New

Community>In The Spotlight

Spotlight: Jamis Buck (Author) Interview and AMA!

Author Spotlight Jamis Buck @jamis This month, we have the pleasure of spotlighting author Jamis Buck, who has written Mazes for Prog...

#author-spotlight /ruby /book-the-ray-tracer-challenge /book-mazes-for-programmers

21 6352 9

2022-09-28 18:21:15 UTC

New

Community>In The Spotlight

Spotlight: VM Brasseur (Author) Interview and AMA!

Author Spotlight: VM Brasseur @vmbrasseur We have a treat for you today! We turn the spotlight onto Open Source as we sit down with V...

#author-spotlight /book-forge-your-future-with-open-source

16 5051 11

2023-03-27 16:00:12 UTC

New

General Dev>Questions

Do you prefer regular mechanical keyboards or low profile mechanical keyboards and why?

I have always used antique keyboards like Cherry MX 1800 or Cherry MX 8100 and almost always have modified the switches in some way, like...

/keyboards #mechanical-keyboards

27 3877 9

2023-02-06 21:10:15 UTC

New

AI>Chat

How to: Run DeepSeek on Mac, Windows, and Linux!

This is a very quick guide, you just need to: Download LM Studio: https://lmstudio.ai/ Click on search Type DeepSeek, then select the o...

#macs /deepseek #guides #lm-studio

14 9328 10

2025-06-19 15:11:16 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Distributed Services With Go - Agent_test.go error line 77

Effective Testing with RSpec 3: Running Sequel migrations fails (page 84)

Hands-on Rust: can_place logic is "inside out"

The Ray Tracer Challenge: "Computing the normal on a transformed sphere" ebook test

Hands-on Rust: question about get_component

Web Development with Clojure, Third Edition (vB17.0): create table syntax invalid

Build a Weather Station with Elixir and Nerves: SGP30 vs SGP40

Build a Weather Station with Elixir and Nerves: Problem connecting to Postgres with Grafana

Real Time Phoenix Errata P17: Getting first sample working with Phoenix 1.6.x

Programming Machine Learning: Setting up your system (p 13)