kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Python Testing with pytest: pytest now requires markers to be declared (downloadable code)

Many tasks_proj/tests directories exist in chapters 2, 3, 5 that have tests that use the custom markers smoke and get, which are not decl...

#errata /book-python-testing-with-pytest

2 1383 2

2021-02-16 14:15:02 UTC

New

PragProg Customers

Distributed Services with Go: Chapter 3 suggestions

Page 28: It implements io.ReaderAt on the store type. Sorry if it’s a dumb question but was the io.ReaderAt supposed to be io.ReadAt? ...

#errata /book-distributed-services-with-go

0 1302 3

2022-07-27 14:35:18 UTC

New

PragProg Customers

Programming Phoenix LiveView: Typo

Hi! I know not the intentions behind this narrative when called, on page XI: mount() |> handle_event() |> render() but the correc...

#errata /book-programming-phoenix-liveview

3 1307 17

2021-03-11 16:34:20 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition (vB17.0): create table syntax invalid

Title: Web Development with Clojure, Third Edition, vB17.0 (p9) The create table guestbook syntax suggested doesn’t seem to be accepted ...

#errata /book-web-development-with-clojure-third-edition

0 1835 1

2021-08-13 23:56:52 UTC

New

PragProg Customers

Distributed Services With Go: Unable to pass readiness/liveness checks. (page 210, 215)

I’m not quite sure what’s going on here, but I’m unable to have to containers successfully complete the Readiness/Liveness checks. I’m im...

/book-distributed-services-with-go

5 1420 5

2022-08-31 00:14:29 UTC

New

PragProg Customers

Programming Phoenix LiveView: Display Image Uploads (pdf p142)

The markup used to display the uploaded image results in a Phoenix.LiveView.HTMLTokenizer.ParseError error. lib/pento_web/live/product_l...

#errata /book-programming-phoenix-liveview

2 2102 9

2022-07-05 17:58:54 UTC

New

PragProg Customers

Programming Phoenix LiveView: B6.0 pg 56 - current-user not set

It seems the second code snippet is missing the code to set the current_user: current_user: Accounts.get_user_by_session_token(session["...

#errata /book-programming-phoenix-liveview

0 1898 8

2023-01-11 03:06:26 UTC

New

PragProg Customers

Real-Time Phoenix: ProductChannelTest - undefined function describe/2 (pg 203)

Hi, I am getting an error I cannot figure out on my test. I have what I think is the exact code from the book, other than I changed “us...

#question /book-real-time-phoenix

0 1775 6

2022-02-16 19:15:15 UTC

New

PragProg Customers

Agile Web Development with Rails 7: Reloading assets in development mode

Hi all, currently I wonder how the Tailwind colours work (or don’t work). For example, in app/views/layouts/application.html.erb I have...

#question /book-agile-web-development-with-rails-7

2 1380 4

2022-02-18 10:00:49 UTC

New

PragProg Customers

Bug with dx/build - how to workaround until fix is up

Hello faithful readers! If you have tried to follow along in the book, you are asked to start up the dev environment via dx/build and ar...

#errata /book-ruby-on-rails-background-jobs-with-sidekiq

3 1178 19

2024-01-23 22:22:16 UTC

New

Other popular topics

General Dev>Dev Chat

What dev-related stuff have you been up to?

Reading something? Working on something? Planning something? Changing jobs even!? If you’re up for sharing, please let us know what you’...

#community

1051 21715 396

2026-02-05 08:11:31 UTC

New

Backend>Learning Resources

Web Development with Clojure, Third Edition

Stop developing web apps with yesterday’s tools. Today, developers are increasingly adopting Clojure as a web-development platform. See f...

pragprog.com

#pragprog #web-development /clojure #published-book /book-web-development-with-clojure-third-edition

5 4584 1

2022-01-06 05:27:09 UTC

New

Backend>Chat

Would you use Erlang now when there is Elixir?

Why, if your answer is yes?

/elixir /erlang

167 4955 52

2021-04-22 18:15:44 UTC

New

General Dev>Hardware

GMK Serika Keycaps - Serika 2 available to order now!

I have seen the keycaps I want - they are due for a group-buy this week but won’t be delivered until October next year!!! :rofl: The Ser...

/keyboards #keycaps #mechanical-keyboards

9 5097 7

2020-12-05 21:32:30 UTC

New

Backend>Learning Resources

Python Testing with pytest, Second Edition

Create efficient, elegant software tests in pytest, Python's most powerful testing framework. Brian Okken @brianokken Edited by Kat...

pragprog.com

#pragprog /python #published-book /book-python-testing-with-pytest-second-edition

16 7461 4

2021-06-25 16:57:39 UTC

New

Backend>Learning Resources

Agile Web Development with Rails 7

Rails 7 completely redefines what it means to produce fantastic user experiences and provides a way to achieve all the benefits of single...

pragprog.com

#pragprog #web-development /ruby /rails #published-book /book-agile-web-development-with-rails-7

32 6600 9

2022-01-26 18:28:44 UTC

New

General Dev>Code Editors

Doom-Emacs: Can't find emacs in your PATH

If you get Can't find emacs in your PATH when trying to install Doom Emacs on your Mac you… just… need to install Emacs first! :lol: bre...

#macos /emacs #doom-emacs

4 5837 0

2022-02-04 00:32:03 UTC

New

Community>In The Spotlight

Spotlight: Erin Dees (Author) Interview and AMA!

Author Spotlight Erin Dees @undees Welcome to our new author spotlight! We had the pleasure of chatting with Erin Dees, co-author of ...

#author-spotlight /ruby /rails /book-effective-testing-with-rspec-3 /book-seven-more-languages-in-seven-weeks /book-cucumber-recipes #rspec

24 4247 11

2023-03-27 15:52:01 UTC

New

General Dev>Learning Resources

A Common-Sense Guide to Data Structures and Algorithms in Python, Volume 1

Big O Notation can make your code faster by orders of magnitude. Get the hands-on info you need to master data structures and algorithms ...

pragprog.com

#pragprog /python #published-book /book-a-common-sense-guide-to-data-structures-and-algorithms-in-python-volume-1

24 5988 11

2024-01-29 15:52:29 UTC

New

Game Dev>Chat

Hair Salon Games for Girls Fun

Hair Salon Games for Girls Fun Girls Hair Saloon game is mainly developed for kids. This game allows users to select virtual avatars to ...

#ios #android #unity #fun

2 3556 1

2025-02-27 10:48:33 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Python Testing with pytest: pytest now requires markers to be declared (downloadable code)