kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

The Pragmatic Programmer, 20th Anniversary Edition errata

Some minor things in the paper edition that says “3 2020” on the title page verso, not mentioned in the book’s errata online: p. 186 But...

#errata /book-the-pragmatic-programmer-20th-anniversary-edition

10 2636 9

2024-09-02 13:34:40 UTC

New

PragProg Customers

Python Testing with pytest: pytest now requires markers to be declared (downloadable code)

Many tasks_proj/tests directories exist in chapters 2, 3, 5 that have tests that use the custom markers smoke and get, which are not decl...

#errata /book-python-testing-with-pytest

2 1383 2

2021-02-16 14:15:02 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition: migrations/create not working: p159

Title: Web Development with Clojure, Third Edition - migrations/create not working: p159 When I execute the command: user=> (create-...

#question /book-web-development-with-clojure-third-edition

5 1084 2

2020-11-14 22:24:32 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition: (create-migration "guestbook") not working (page 9)

When I try the command to create a pair of migration files I get an error. user=> (create-migration "guestbook") Execution error (Ill...

#errata /book-web-development-with-clojure-third-edition

5 1788 4

2023-07-27 14:17:36 UTC

New

PragProg Customers

Distributed Services with Go: Chapter 1 Suggestions

Hi Travis! Thank you for the cool book! :slight_smile: I made a list of issues and thought I could post them chapter by chapter. I’m rev...

#errata /book-distributed-services-with-go

2 1185 3

2021-11-05 17:53:55 UTC

New

PragProg Customers

Distributed Services With Go: Unable to pass readiness/liveness checks. (page 210, 215)

I’m not quite sure what’s going on here, but I’m unable to have to containers successfully complete the Readiness/Liveness checks. I’m im...

/book-distributed-services-with-go

5 1420 5

2022-08-31 00:14:29 UTC

New

PragProg Customers

Real-Time Phoenix: ProductChannelTest - undefined function describe/2 (pg 203)

Hi, I am getting an error I cannot figure out on my test. I have what I think is the exact code from the book, other than I changed “us...

#question /book-real-time-phoenix

0 1775 6

2022-02-16 19:15:15 UTC

New

PragProg Customers

Agile Web Development with Rails 7: Reloading assets in development mode

Hi all, currently I wonder how the Tailwind colours work (or don’t work). For example, in app/views/layouts/application.html.erb I have...

#question /book-agile-web-development-with-rails-7

2 1380 4

2022-02-18 10:00:49 UTC

New

PragProg Customers

Agile Web Development with Rails 7: page 152, page 153:

AWDWR 7, page 152, page 153: Hello everyone, I’m a little bit lost on the hotwire part. I didn’t fully understand it. On page 152 @rub...

#question /book-agile-web-development-with-rails-7

0 1230 4

2023-01-16 15:26:22 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: error concerning function getCurrentStandings in BaseballDao.java

@mfazio23 I’m following the indications of the book and arriver ad chapter 10, but the app cannot be compiled due to an error in the Bas...

#question /book-kotlin-and-android-development-featuring-jetpack

1 3397 6

2022-07-22 14:06:06 UTC

New

Other popular topics

General Dev>Hardware

Which keyboard do you have?

If it’s a mechanical keyboard, which switches do you have? Would you recommend it? Why? What will your next keyboard be? Pics always w...

#hardware /keyboards #sticky #mechanical-keyboards

144 9115 50

2021-01-07 23:58:36 UTC

New

General Dev>Dev Chat

Which vertical monitor do you use?

I’m thinking of buying a monitor that I can rotate to use as a vertical monitor? Also, I want to know if someone is using it for program...

#monitors #programming

51 4892 20

2023-06-28 07:23:42 UTC

New

Data Science

Genetic Algorithms in Elixir

From finance to artificial intelligence, genetic algorithms are a powerful tool with a wide array of applications. But you don't need an ...

#pragprog #ai /elixir #published-book /book-genetic-algorithms-in-elixir

25 5243 6

2021-02-09 12:32:09 UTC

New

Science/Tech>Health & Diet

David Sinclair's new Lifespan podcast

We’ve talked about his book briefly here but it is quickly becoming obsolete - so he’s decided to create a series of 7 podcasts, the firs...

#health #podcasts #bio-hackers #david-sinclair

87 6790 49

2022-04-12 16:27:36 UTC

New

macOS>Chat

How to block any website on Mac using Little Snitch

If you want a quick and easy way to block any website on your Mac using Little Snitch simply… File > New Rule: And select Deny, O...

#macos #how-to #littlesnitch

5 11227 3

2022-07-05 00:59:40 UTC

New

Backend>Learning Resources

Programming Ruby 3.2 (5th Edition)

Programming Ruby is the most complete book on Ruby, covering both the language itself and the standard library as well as commonly used t...

twitter.com

#pragprog /ruby /rails #published-book /book-programming-ruby-3-2-5th-edition

28 8550 13

2024-11-17 04:34:14 UTC

New

General Dev>Questions

Do you prefer regular mechanical keyboards or low profile mechanical keyboards and why?

I have always used antique keyboards like Cherry MX 1800 or Cherry MX 8100 and almost always have modified the switches in some way, like...

/keyboards #mechanical-keyboards

27 3877 9

2023-02-06 21:10:15 UTC

New

Backend>Learning Resources

Machine Learning in Elixir

Leverage Elixir and the Nx ecosystem to build intelligent applications that solve real-world problems in computer vision, natural languag...

pragprog.com

#pragprog /elixir #published-book #machine-learning #nx /book-machine-learning-in-elixir

18 4615 7

2024-11-08 22:13:04 UTC

New

Android>Questions

Unresolved Reference to android in build.gradle.kts – Beginner Issue

Hello, I’m a beginner in Android development and I’m facing an issue with my project setup. In my build.gradle.kts file, I have the foll...

#binding

0 7460 2

2024-12-09 21:07:33 UTC

New

Backend>Official News

Node.js v22.14.0 released!

Node.js v22.14.0 has been released. Link: Release 2025-02-11, Version 22.14.0 'Jod' (LTS), @aduh95 · nodejs/node · GitHub

github.com

/nodejs #official-news

0 4251 0

2025-02-11 15:30:14 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

The Pragmatic Programmer, 20th Anniversary Edition errata

Python Testing with pytest: pytest now requires markers to be declared (downloadable code)

Web Development with Clojure, Third Edition: migrations/create not working: p159

Web Development with Clojure, Third Edition: (create-migration "guestbook") not working (page 9)

Distributed Services with Go: Chapter 1 Suggestions

Distributed Services With Go: Unable to pass readiness/liveness checks. (page 210, 215)

Real-Time Phoenix: ProductChannelTest - undefined function describe/2 (pg 203)

Agile Web Development with Rails 7: Reloading assets in development mode

Agile Web Development with Rails 7: page 152, page 153:

Kotlin and Android Development featuring Jetpack: error concerning function getCurrentStandings in BaseballDao.java