kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Warnings in Python Testing With Pytest Chapter 2

Python Testing With Pytest - Chapter 2, warnings for “unregistered custom marks” While running the smoke tests in Chapter 2, I get these...

#pragprog #errata /book-python-testing-with-pytest

5 2081 1

2020-07-27 19:33:14 UTC

New

PragProg Customers

Apple Game Frameworks and Technologies: Screen image may be wrong (p 13)

Working through the steps (checking that the Info,plist matches exactly), run the demo game and what appears is grey but does not fill th...

#errata /book-apple-game-frameworks-and-technologies

11 1081 5

2021-05-15 17:31:07 UTC

New

PragProg Customers

Programming Flutter: Image.toByteData() does not exist (page40)

your book suggests to use Image.toByteData() to convert image to bytes, however I get the following error: "the getter ‘toByteData’ isn’t...

/book-programming-flutter #question

1 4102 2

2021-02-23 16:03:08 UTC

New

PragProg Customers

Intuitive Python: docker run… denied error (page 2)

Title: Intuitive Python: docker run… denied error (page 2) Attempted to run the docker command in both CLI and Powershell PS C:\Users\r...

#errata /book-intuitive-python

9 1263 4

2021-04-06 16:33:24 UTC

New

PragProg Customers

Build a Weather Station with Elixir and Nerves: SGP30 vs SGP40

This is as much a suggestion as a question, as a note for others. Locally the SGP30 wasn’t available, so I ordered a SGP40. On page 53, ...

#suggestion /book-build-a-weather-station-with-elixir-and-nerves

0 1292 2

2024-03-20 19:56:42 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: android:tint vs app:tint (chapter 7, p186)

I found an issue in Chapter 7 regarding android:backgroundTint vs app:backgroundTint. How to replicate: load chapter-7 from zipfile i...

#errata /book-kotlin-and-android-development-featuring-jetpack

0 3566 3

2022-04-26 09:10:52 UTC

New

PragProg Customers

Build a Weather Station with Elixir and Nerves: Problem connecting to Postgres with Grafana

Title: Build a Weather Station with Elixir and Nerves: Problem connecting to Postgres with Grafana on (page 64) If you follow the defau...

#errata /book-build-a-weather-station-with-elixir-and-nerves

0 1962 4

2021-11-16 04:25:39 UTC

New

PragProg Customers

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)

root_layout: {PentoWeb.LayoutView, :root}, This results in the following following error: no “root” html template defined for PentoWeb...

#errata /book-programming-phoenix-liveview

8 1094 4

2023-10-22 17:25:26 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: Unique constraint error when running chapter 5 code changes

@mfazio23 I’ve applied the changes from Chapter 5 of the book and everything builds correctly and runs. But, when I try to start a game,...

/book-kotlin-and-android-development-featuring-jetpack

0 1180 10

2023-08-07 20:43:16 UTC

New

PragProg Customers

Programming Machine Learning: Setting up your system (p 13)

From page 13: On Python 3.7, you can install the libraries with pip by running these commands inside a Python venv using Visual Studio ...

#question /book-programming-machine-learning

1 989 3

2023-10-09 07:44:15 UTC

New

Other popular topics

Science/Tech>Health & Diet

How do you keep fit and healthy?

@AstonJ prompted me to open this topic after I mentioned in the lockdown thread how I started to do a lot more for my fitness. https://f...

#fitness #heath

193 4981 82

2023-01-23 06:00:46 UTC

New

General Dev>Hardware

What monitor(s) do you have for programming?

Please tell us what is your preferred monitor setup for programming(not gaming) and why you have chosen it. Does your monitor have eye p...

#monitors #coding #programming #development

227 11362 88

2022-02-01 12:02:08 UTC

New

Backend>Questions

Can someone explain the -t option/flag in docker run command?

I know that -t flag is used along with -i flag for getting an interactive shell. But I cannot digest what the man page for docker run com...

#docker

7 10261 2

2020-09-01 07:19:16 UTC

New

General Dev>Code Editors

Poll: Which code editor do you use?

You might be thinking we should just ask who’s not using VSCode :joy: however there are some new additions in the space that might give V...

#community #polls /vim /emacs #code-editors /vscode #notepad /sublime-text #atom /textmate #codespaces #brackets /onivim #geany

121 5796 61

2025-09-05 00:52:19 UTC

New

Linux>Questions

What is the most minimalist Linux server distro?

I am asking for any distro that only has the bare-bones to be able to get a shell in the server and then just install the packages as we ...

#linux #servers

66 25846 24

2022-04-13 13:30:03 UTC

New

General Dev>Dev Chat

Languages Without Garbage Collection

Continuing the discussion from Thinking about learning Crystal, let’s discuss - I was wondering which languages don’t GC - maybe we can c...

#garbage-collection

21 5575 7

2021-05-06 05:54:58 UTC

New

General Dev>Dev Chat

PragProg’s Medium Posts

Hello everyone! This thread is to tell you about what authors from The Pragmatic Bookshelf are writing on Medium.

#pragprog #blog-post

1147 29994 760

2025-07-10 13:36:16 UTC

New

Community>In The Spotlight

Spotlight: VM Brasseur (Author) Interview and AMA!

Author Spotlight: VM Brasseur @vmbrasseur We have a treat for you today! We turn the spotlight onto Open Source as we sit down with V...

#author-spotlight /book-forge-your-future-with-open-source

16 5051 11

2023-03-27 16:00:12 UTC

New

Backend>Learning Resources

Agile Web Development with Rails 8

Get the comprehensive, insider information you need for Rails 8 with the new edition of this award-winning classic. Sam Ruby @rubys ...

pragprog.com

#pragprog #web-development /ruby /rails #published-book /book-agile-web-development-with-rails-8

12 7404 7

2025-03-27 18:33:39 UTC

New

AI>In The News

DeepSeek (671B) running on a cluster of 8 Mac Mini Pros with 64GB RAM each

This is cool! DEEPSEEK-V3 ON M4 MAC: BLAZING FAST INFERENCE ON APPLE SILICON We just witnessed something incredible: the largest open-s...

#ai #macs /deepseek

0 6695 1

2025-01-29 18:43:37 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Warnings in Python Testing With Pytest Chapter 2

Apple Game Frameworks and Technologies: Screen image may be wrong (p 13)

Programming Flutter: Image.toByteData() does not exist (page40)

Intuitive Python: docker run… denied error (page 2)

Build a Weather Station with Elixir and Nerves: SGP30 vs SGP40

Kotlin and Android Development featuring Jetpack: android:tint vs app:tint (chapter 7, p186)

Build a Weather Station with Elixir and Nerves: Problem connecting to Postgres with Grafana

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)

Kotlin and Android Development featuring Jetpack: Unique constraint error when running chapter 5 code changes

Programming Machine Learning: Setting up your system (p 13)