kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Distributed Services With Go - Ch 3 index errors on Config

In Chapter 3, the source for index introduces Config on page 31, followed by more code including tests; Config isn’t introduced until pag...

#pragprog #errata /book-distributed-services-with-go

8 1316 3

2021-04-08 12:48:40 UTC

New

PragProg Customers

Warnings in Python Testing With Pytest Chapter 2

Python Testing With Pytest - Chapter 2, warnings for “unregistered custom marks” While running the smoke tests in Chapter 2, I get these...

#pragprog #errata /book-python-testing-with-pytest

5 2081 1

2020-07-27 19:33:14 UTC

New

PragProg Customers

Build Websites with Hugo: Code will not run in a working Hugo setup

Hello Brian, I have some problems with running the code in your book. I like the style of the book very much and I have learnt a lot as...

#question /book-build-websites-with-hugo

0 1501 3

2021-01-29 18:54:24 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition: Issue adding Shadow CLJS

Title: Web Development with Clojure, Third Edition, pg 116 Hi - I just started chapter 5 and I am stuck on page 116 while trying to star...

#question /book-web-development-with-clojure-third-edition

4 1199 4

2021-01-10 05:30:17 UTC

New

PragProg Customers

Programming Flutter: Image.toByteData() does not exist (page40)

your book suggests to use Image.toByteData() to convert image to bytes, however I get the following error: "the getter ‘toByteData’ isn’t...

/book-programming-flutter #question

1 4102 2

2021-02-23 16:03:08 UTC

New

PragProg Customers

Programming Machine Learning: Incorrect formula

Hi everyone! There is an error on the page 71 in the book “Programming machine learning from coding to depp learning” P. Perrotta. You c...

#errata /book-programming-machine-learning

5 1341 4

2022-04-06 12:03:54 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: $kotlin_version ? (page 8)

I’m running Android Studio “Arctic Fox” 2020.3.1 Patch 2, and I’m embarrassed to admit that I only made it to page 8 before running into ...

#errata /book-kotlin-and-android-development-featuring-jetpack

0 1698 3

2021-09-03 21:44:18 UTC

New

PragProg Customers

Programming Phoenix LiveView: book not updated to version 1.6 (p. 18)

In general, the book isn’t yet updated for Phoenix version 1.6. On page 18 of the book, the authors indicate that an auto generated of ro...

#errata /book-programming-phoenix-liveview

9 2051 12

2022-02-08 11:31:40 UTC

New

PragProg Customers

iOS Unit Testing by Example: 54 Don't seem to be getting the print out on tests (Xcode 13.2)

Hey there, I’m enjoying this book and have learned a few things alredayd. However, in Chapter 4 I believe we are meant to see the “>...

#question /book-ios-unit-testing-by-example

0 1963 3

2022-01-24 15:18:41 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: Unique constraint error when running chapter 5 code changes

@mfazio23 I’ve applied the changes from Chapter 5 of the book and everything builds correctly and runs. But, when I try to start a game,...

/book-kotlin-and-android-development-featuring-jetpack

0 1180 10

2023-08-07 20:43:16 UTC

New

Other popular topics

General Dev>Dev Chat

What are you listening to?

A thread that every forum needs! Simply post a link to a track on YouTube (or SoundCloud or Vimeo amongst others!) on a separate line an...

#community #music

202 5126 102

2025-07-26 22:00:31 UTC

New

General Dev>Learning Resources

Forge Your Future with Open Source

Free and open source software is the default choice for the technologies that run our world, and it’s built and maintained by people like...

pragprog.com

#pragprog #published-book /book-forge-your-future-with-open-source

3 5654 0

2020-04-21 18:37:36 UTC

New

Backend>Learning Resources

Concurrent Data Processing in Elixir

Learn different ways of writing concurrent code in Elixir and increase your application's performance, without sacrificing scalability or...

pragprog.com

#pragprog /elixir #published-book /book-concurrent-data-processing-in-elixir

78 6059 24

2021-09-04 12:35:42 UTC

New

General Dev>Dev Chat

PragProg’s Medium Posts

Hello everyone! This thread is to tell you about what authors from The Pragmatic Bookshelf are writing on Medium.

#pragprog #blog-post

1147 29994 760

2025-07-10 13:36:16 UTC

New

Frontend>Chat

Online Hand to eye coordination test

Was just curious to see if any were around, found this one: I got 51/100: Not sure if it was meant to buy I am sure at times the b...

#online-tools

4 4562 1

2022-03-27 10:53:45 UTC

New

macOS>Chat

How to block any website on Mac using Little Snitch

If you want a quick and easy way to block any website on your Mac using Little Snitch simply… File > New Rule: And select Deny, O...

#macos #how-to #littlesnitch

5 11227 3

2022-07-05 00:59:40 UTC

New

Backend>Learning Resources

Programming Ruby 3.2 (5th Edition)

Programming Ruby is the most complete book on Ruby, covering both the language itself and the standard library as well as commonly used t...

twitter.com

#pragprog /ruby /rails #published-book /book-programming-ruby-3-2-5th-edition

28 8550 13

2024-11-17 04:34:14 UTC

New

Backend>Learning Resources

Engineering Elixir Applications

Develop, deploy, and debug BEAM applications using BEAMOps: a new paradigm that focuses on scalability, fault tolerance, and owning each ...

pragprog.com

#pragprog /elixir #published-book /book-engineering-elixir-applications

40 7136 21

2024-11-08 15:13:02 UTC

New

Android>Questions

Unresolved Reference to android in build.gradle.kts – Beginner Issue

Hello, I’m a beginner in Android development and I’m facing an issue with my project setup. In my build.gradle.kts file, I have the foll...

#binding

0 7460 2

2024-12-09 21:07:33 UTC

New

Backend>Learning Resources

Advanced Functional Programming with Elixir

Use advanced functional programming principles, practical Domain-Driven Design techniques, and production-ready Elixir code to build scal...

joekoski.com

#pragprog /elixir #published-book #functional-programming /book-advanced-functional-programming-with-elixir

43 4989 22

2025-10-06 09:04:44 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Distributed Services With Go - Ch 3 index errors on Config

Warnings in Python Testing With Pytest Chapter 2

Build Websites with Hugo: Code will not run in a working Hugo setup

Web Development with Clojure, Third Edition: Issue adding Shadow CLJS

Programming Flutter: Image.toByteData() does not exist (page40)

Programming Machine Learning: Incorrect formula

Kotlin and Android Development featuring Jetpack: $kotlin_version ? (page 8)

Programming Phoenix LiveView: book not updated to version 1.6 (p. 18)

iOS Unit Testing by Example: 54 Don't seem to be getting the print out on tests (Xcode 13.2)

Kotlin and Android Development featuring Jetpack: Unique constraint error when running chapter 5 code changes