kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Apple Game Frameworks and Technologies: Screen image may be wrong (p 13)

Working through the steps (checking that the Info,plist matches exactly), run the demo game and what appears is grey but does not fill th...

#errata /book-apple-game-frameworks-and-technologies

11 1081 5

2021-05-15 17:31:07 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition: Issue adding Shadow CLJS

Title: Web Development with Clojure, Third Edition, pg 116 Hi - I just started chapter 5 and I am stuck on page 116 while trying to star...

#question /book-web-development-with-clojure-third-edition

4 1199 4

2021-01-10 05:30:17 UTC

New

PragProg Customers

Programming Machine Learning: Incorrect formula

Hi everyone! There is an error on the page 71 in the book “Programming machine learning from coding to depp learning” P. Perrotta. You c...

#errata /book-programming-machine-learning

5 1341 4

2022-04-06 12:03:54 UTC

New

PragProg Customers

Modern Front-End Development for Rails: B7 no main folder in the source code (page xv)

On the page xv there is an instruction to run bin/setup from the main folder. I downloaded the source code today (12/03/21) and can’t see...

#errata /book-modern-front-end-development-for-rails

2 1452 11

2022-03-08 17:27:57 UTC

New

PragProg Customers

Modern Front-End Development for Rails: ERROR in tsconfig.json Chapter_01/01

@noelrappin Running the webpack dev server, I receive the following warning: ERROR in tsconfig.json TS18003: No inputs were found in c...

/book-modern-front-end-development-for-rails

3 1438 3

2021-09-02 19:11:59 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: InterpreterNotFound error when running tox (page 150)

When running tox for the first time, I got the following error: ERROR: InterpreterNotFound: python3.10 I realised that I was running ...

#errata /book-python-testing-with-pytest-second-edition

0 1306 1

2021-12-10 05:06:56 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: allprojects should be moved to settings.gradle (page 245)

The allprojects block listed on page 245 produces the following error when syncing gradle: “org.gradle.api.GradleScriptException: A prob...

#suggestion /book-kotlin-and-android-development-featuring-jetpack

1 2304 1

2022-02-26 23:52:12 UTC

New

PragProg Customers

Modern front-end development for Rails, second edition - Struggling to get the first chapter to work

After running /bin/setup, the first error was: The foreman' command exists in these Ruby versions: That was easy to fix: gem install fore...

#errata /book-modern-front-end-development-for-rails

1 1116 3

2023-06-22 14:09:32 UTC

New

PragProg Customers

The Definitive ANTLR 4 Reference - "Java.g4" grammer (used on page 40) no longer passes ANTLR

@parrt In the context of Chapter 4.3, the grammar Java.g4, meant to parse Java 6 compilation units, no longer passes ANTLR (currently 4....

#errata /book-the-definitive-antlr-4-reference

0 1020 3

2023-02-14 01:34:49 UTC

New

PragProg Customers

Programming Machine Learning: Setting up your system (p 13)

From page 13: On Python 3.7, you can install the libraries with pip by running these commands inside a Python venv using Visual Studio ...

#question /book-programming-machine-learning

1 989 3

2023-10-09 07:44:15 UTC

New

Other popular topics

Backend>Learning Resources

Programming Machine Learning

Machine learning can be intimidating, with its reliance on math and algorithms that most programmers don't encounter in their regular wor...

pragprog.com

#pragprog #ai /python #published-book /book-programming-machine-learning #math #algorithms

6 5350 3

2023-10-03 15:08:13 UTC

New

Backend>Learning Resources

Seven Languages in Seven Weeks

Ruby, Io, Prolog, Scala, Erlang, Clojure, Haskell. With Seven Languages in Seven Weeks, by Bruce A. Tate, you’ll go beyond the syntax—and...

pragprog.com

#pragprog /clojure /erlang /haskell /prolog /ruby /scala #published-book /book-seven-languages-in-seven-weeks

5 5730 1

2022-01-20 13:48:55 UTC

New

Backend>Learning Resources

Testing Elixir

Write Elixir tests that you can be proud of. Dive into Elixir’s test philosophy and gain mastery over the terminology and concepts that u...

pragprog.com

#pragprog /elixir #published-book /book-testing-elixir

33 5004 8

2021-01-05 06:17:50 UTC

New

General Dev>Dev Chat

Standing Desks

No chair. I have a standing desk. This post was split into a dedicated thread from our thread about chairs :slight_smile:

#workspace #opinions

177 9886 77

2022-09-27 18:40:05 UTC

New

Backend>Questions

Can someone explain the -t option/flag in docker run command?

I know that -t flag is used along with -i flag for getting an interactive shell. But I cannot digest what the man page for docker run com...

#docker

7 10261 2

2020-09-01 07:19:16 UTC

New

Backend>Learning Resources

Programming Phoenix LiveView

Build highly interactive applications without ever leaving Elixir, the way the experts do. Let LiveView take care of performance, scalabi...

pragprog.com

#pragprog /elixir /phoenix #published-book /book-programming-phoenix-liveview

83 11955 26

2026-03-24 14:01:24 UTC

New

macOS>Chat

How to block any website on Mac using Little Snitch

If you want a quick and easy way to block any website on your Mac using Little Snitch simply… File > New Rule: And select Deny, O...

#macos #how-to #littlesnitch

5 11227 3

2022-07-05 00:59:40 UTC

New

General Dev>In The News

X can’t stop spread of explicit, fake AI Taylor Swift images

Will Swifties’ war on AI fakes spark a deepfake porn reckoning?

arstechnica.com

/swift

0 8379 0

2024-01-26 05:47:12 UTC

New

Game Dev>Questions

I want to learn how make a game, but where should I start?

I’m able to do the “artistic” part of game-development; character designing/modeling, music, environment modeling, etc. However, I don’t...

#game-dev

15 4965 9

2025-10-18 13:12:58 UTC

New

Backend>Learning Resources

Agile Web Development with Rails 8

Get the comprehensive, insider information you need for Rails 8 with the new edition of this award-winning classic. Sam Ruby @rubys ...

pragprog.com

#pragprog #web-development /ruby /rails #published-book /book-agile-web-development-with-rails-8

12 7404 7

2025-03-27 18:33:39 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Apple Game Frameworks and Technologies: Screen image may be wrong (p 13)

Web Development with Clojure, Third Edition: Issue adding Shadow CLJS

Programming Machine Learning: Incorrect formula

Modern Front-End Development for Rails: B7 no main folder in the source code (page xv)

Modern Front-End Development for Rails: ERROR in tsconfig.json Chapter_01/01

Python Testing with pytest, Second Edition: InterpreterNotFound error when running tox (page 150)

Kotlin and Android Development featuring Jetpack: allprojects should be moved to settings.gradle (page 245)

Modern front-end development for Rails, second edition - Struggling to get the first chapter to work

The Definitive ANTLR 4 Reference - "Java.g4" grammer (used on page 40) no longer passes ANTLR

Programming Machine Learning: Setting up your system (p 13)