kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Warnings in Python Testing With Pytest Chapter 2

Python Testing With Pytest - Chapter 2, warnings for “unregistered custom marks” While running the smoke tests in Chapter 2, I get these...

#pragprog #errata /book-python-testing-with-pytest

5 2081 1

2020-07-27 19:33:14 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition: (create-migration "guestbook") not working (page 9)

When I try the command to create a pair of migration files I get an error. user=> (create-migration "guestbook") Execution error (Ill...

#errata /book-web-development-with-clojure-third-edition

5 1788 4

2023-07-27 14:17:36 UTC

New

PragProg Customers

The Ray Tracer Challenge: "Computing the normal on a transformed sphere" ebook test

Hi Jamis, I think there’s an issue with a test on chapter 6. I own the ebook, version P1.0 Feb. 2019. This test doesn’t pass for me: ...

#errata /book-the-ray-tracer-challenge

10 1461 5

2025-01-13 14:42:44 UTC

New

PragProg Customers

Intuitive Python: docker run… denied error (page 2)

Title: Intuitive Python: docker run… denied error (page 2) Attempted to run the docker command in both CLI and Powershell PS C:\Users\r...

#errata /book-intuitive-python

9 1263 4

2021-04-06 16:33:24 UTC

New

PragProg Customers

Build a Weather Station with Elixir and Nerves: Problem connecting to Postgres with Grafana

Title: Build a Weather Station with Elixir and Nerves: Problem connecting to Postgres with Grafana on (page 64) If you follow the defau...

#errata /book-build-a-weather-station-with-elixir-and-nerves

0 1962 4

2021-11-16 04:25:39 UTC

New

PragProg Customers

Programming Phoenix LiveView: book not updated to version 1.6 (p. 18)

In general, the book isn’t yet updated for Phoenix version 1.6. On page 18 of the book, the authors indicate that an auto generated of ro...

#errata /book-programming-phoenix-liveview

9 2051 12

2022-02-08 11:31:40 UTC

New

PragProg Customers

Real Time Phoenix Errata P17: Getting first sample working with Phoenix 1.6.x

Skimming ahead, much of the following is explained in Chapter 3, but new readers (like me!) will hit a roadblock in Chapter 2 with their ...

#errata /book-real-time-phoenix

6 1116 5

2022-12-08 12:49:23 UTC

New

PragProg Customers

Real-Time Phoenix: use PubSub with implementation of Phoenix.Socket.Transport rather than channels (page 37)

Hi, I’ve got a question about the implementation of PubSub when using a Phoenix.Socket.Transport behaviour rather than channels. Before ...

#question /book-real-time-phoenix #websockets #phoenixsocket #pubsub

0 1528 3

2022-02-28 15:41:06 UTC

New

PragProg Customers

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)

root_layout: {PentoWeb.LayoutView, :root}, This results in the following following error: no “root” html template defined for PentoWeb...

#errata /book-programming-phoenix-liveview

8 1094 4

2023-10-22 17:25:26 UTC

New

PragProg Customers

Machine Learning in Elixir:Error installing EXLA dependency - Page 25

Getting an error when installing the dependencies at the start of this chapter: could not compile dependency :exla, "mix compile" failed...

#errata /book-machine-learning-in-elixir

1 1159 10

2025-01-03 12:05:01 UTC

New

Other popular topics

General Dev>Dev Chat

What dev-related stuff have you been up to?

Reading something? Working on something? Planning something? Changing jobs even!? If you’re up for sharing, please let us know what you’...

#community

1052 22283 402

2026-03-23 08:22:18 UTC

New

General Dev>Hardware

Moonlander Keyboard (Mechanical) (Ergonomic) (Split) (Ortholinear)

Bought the Moonlander mechanical keyboard. Cherry Brown MX switches. Arms and wrists have been hurting enough that it’s time I did someth...

#hardware /keyboards #moonlander #mechanical-keyboards #ortholinear #ergonomic

212 17779 90

2021-07-13 15:33:55 UTC

New

Backend>Questions

Can someone explain the -t option/flag in docker run command?

I know that -t flag is used along with -i flag for getting an interactive shell. But I cannot digest what the man page for docker run com...

#docker

7 10261 2

2020-09-01 07:19:16 UTC

New

Game Dev>Learning Resources

Hands-on Rust: Effective Learning through 2D Game Development and Play

Rust is an exciting new programming language combining the power of C with memory safety, fearless concurrency, and productivity boosters...

pragprog.com

#pragprog /rust #published-book /book-hands-on-rust

117 10879 30

2024-11-09 13:24:20 UTC

New

Backend>Learning Resources

Programming Phoenix LiveView

Build highly interactive applications without ever leaving Elixir, the way the experts do. Let LiveView take care of performance, scalabi...

pragprog.com

#pragprog /elixir /phoenix #published-book /book-programming-phoenix-liveview

83 11955 26

2026-03-24 14:01:24 UTC

New

General Dev>Code Editors

Doom-Emacs: Can't find emacs in your PATH

If you get Can't find emacs in your PATH when trying to install Doom Emacs on your Mac you… just… need to install Emacs first! :lol: bre...

#macos /emacs #doom-emacs

4 5837 0

2022-02-04 00:32:03 UTC

New

Backend>Learning Resources

Effective Haskell

Build efficient applications that exploit the unique benefits of a pure functional language, learning from an engineer who uses Haskell t...

pragprog.com

#pragprog /haskell #published-book /book-effective-haskell

15 10218 1

2022-02-16 10:09:51 UTC

New

AI>In The News

How to fix the eyes in AI-generated images

aidemos.info

0 4508 0

2022-09-10 13:54:33 UTC

New

Android>Questions

Clipboard readtext not working in android webview

Inside our android webview app, we are trying to paste the copied content from another app eg (notes) using navigator.clipboard.readtext ...

#android #clipboard

1 5651 0

2022-09-27 18:52:03 UTC

New

Backend>Learning Resources

Programming Ruby 3.2 (5th Edition)

Programming Ruby is the most complete book on Ruby, covering both the language itself and the standard library as well as commonly used t...

twitter.com

#pragprog /ruby /rails #published-book /book-programming-ruby-3-2-5th-edition

28 8550 13

2024-11-17 04:34:14 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Warnings in Python Testing With Pytest Chapter 2

Web Development with Clojure, Third Edition: (create-migration "guestbook") not working (page 9)

The Ray Tracer Challenge: "Computing the normal on a transformed sphere" ebook test

Intuitive Python: docker run… denied error (page 2)

Build a Weather Station with Elixir and Nerves: Problem connecting to Postgres with Grafana

Programming Phoenix LiveView: book not updated to version 1.6 (p. 18)

Real Time Phoenix Errata P17: Getting first sample working with Phoenix 1.6.x

Real-Time Phoenix: use PubSub with implementation of Phoenix.Socket.Transport rather than channels (page 37)

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)

Machine Learning in Elixir:Error installing EXLA dependency - Page 25

Other popular topics

What dev-related stuff have you been up to?

Moonlander Keyboard (Mechanical) (Ergonomic) (Split) (Ortholinear)

Can someone explain the -t option/flag in docker run command?