kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Apple Game Frameworks and Technologies: Screen image may be wrong (p 13)

Working through the steps (checking that the Info,plist matches exactly), run the demo game and what appears is grey but does not fill th...

#errata /book-apple-game-frameworks-and-technologies

11 1081 5

2021-05-15 17:31:07 UTC

New

PragProg Customers

The Ray Tracer Challenge: "Computing the normal on a transformed sphere" ebook test

Hi Jamis, I think there’s an issue with a test on chapter 6. I own the ebook, version P1.0 Feb. 2019. This test doesn’t pass for me: ...

#errata /book-the-ray-tracer-challenge

10 1461 5

2025-01-13 14:42:44 UTC

New

PragProg Customers

Programming Phoenix LiveView: P27, live_path confusion

I am working on the “Your Turn” for chapter one and building out the restart button talked about on page 27. It recommends looking into ...

#question /book-programming-phoenix-liveview

7 3505 14

2023-08-09 13:36:28 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: cards pip install error (page 12)

#book-python-testing-with-pytest-second-edition Hi. Thanks for writing the book. I am just learning so this might just of been an issue ...

#errata /book-python-testing-with-pytest-second-edition

4 1191 3

2021-07-03 13:40:39 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: unrecognized arguments error (page 122)

When I run the coverage example to report on missing lines, I get: pytest --cov=cards --report=term-missing ch7 ERROR: usage: pytest [op...

#errata /book-python-testing-with-pytest-second-edition

0 4000 1

2021-12-03 05:36:38 UTC

New

PragProg Customers

Programming Phoenix LiveView: book not updated to version 1.6 (p. 18)

In general, the book isn’t yet updated for Phoenix version 1.6. On page 18 of the book, the authors indicate that an auto generated of ro...

#errata /book-programming-phoenix-liveview

9 2051 12

2022-02-08 11:31:40 UTC

New

PragProg Customers

Hands on Rust: Need help with error - thread 'main' panicked at 'Failed to load texture

Hi, I need some help, I’m new to rust and was learning through your book. but I got stuck at the last stage of distribution. Whenever I t...

#question /book-hands-on-rust

3 1989 5

2022-12-03 00:17:31 UTC

New

PragProg Customers

The Ray Tracer Challenge: Cannot get rid of acne When implement Shadows in Chapter 8.

Hi, I’m working on the Chapter 8 of the book. After I add add the point_offset, I’m still able to see acne: In the image above, I re...

#question /book-the-ray-tracer-challenge

1 1052 4

2024-07-09 23:10:34 UTC

New

PragProg Customers

Modern Front-End Development for Rails - application does not start after run bin/setup (page xviii)

After some hassle, I was able to finally run bin/setup, now I have started the rails server but I get this error message right when I vis...

#errata /book-modern-front-end-development-for-rails

0 1461 5

2022-06-03 09:50:10 UTC

New

PragProg Customers

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)

root_layout: {PentoWeb.LayoutView, :root}, This results in the following following error: no “root” html template defined for PentoWeb...

#errata /book-programming-phoenix-liveview

8 1094 4

2023-10-22 17:25:26 UTC

New

Other popular topics

General Dev>Hardware

Which keyboard do you have?

If it’s a mechanical keyboard, which switches do you have? Would you recommend it? Why? What will your next keyboard be? Pics always w...

#hardware /keyboards #sticky #mechanical-keyboards

144 9115 50

2021-01-07 23:58:36 UTC

New

Science/Tech>Tech Chat

What are you watching?

Or looking forward to? :nerd_face:

#community

498 14002 274

2026-04-06 07:20:07 UTC

New

macOS>Chat

My thoughts on macOS vs Linux

Small essay with thoughts on macOS vs. Linux: I know @Exadra37 is just waiting around the corner to scream at me “I TOLD YOU SO!!!” but I...

#macos #linux

166 9730 69

2021-04-10 22:36:29 UTC

New

Backend>Learning Resources

Concurrent Data Processing in Elixir

Learn different ways of writing concurrent code in Elixir and increase your application's performance, without sacrificing scalability or...

pragprog.com

#pragprog /elixir #published-book /book-concurrent-data-processing-in-elixir

78 6059 24

2021-09-04 12:35:42 UTC

New

General Dev>Dev Chat

Languages Without Garbage Collection

Continuing the discussion from Thinking about learning Crystal, let’s discuss - I was wondering which languages don’t GC - maybe we can c...

#garbage-collection

21 5575 7

2021-05-06 05:54:58 UTC

New

Backend>Chat

Data Structures and Algorithms with Elixir

This is going to be a long an frequently posted thread. While talking to a friend of mine who has taken data structure and algorithm cou...

/elixir #algorithms #data-structures

108 11869 31

2024-11-14 02:14:00 UTC

New

Frontend>Chat

Online Hand to eye coordination test

Was just curious to see if any were around, found this one: I got 51/100: Not sure if it was meant to buy I am sure at times the b...

#online-tools

4 4562 1

2022-03-27 10:53:45 UTC

New

General Dev>In The News

Zig now has built-in HTTP server and client in std

zig/http.zig at 7cf2cbb33ef34c1d211135f56d30fe23b6cacd42 · ziglang/zig. General-purpose programming language and toolchain for maintaini...

github.com

/zig #http

0 5624 0

2023-05-19 00:35:41 UTC

New

General Dev>In The News

X can’t stop spread of explicit, fake AI Taylor Swift images

Will Swifties’ war on AI fakes spark a deepfake porn reckoning?

arstechnica.com

/swift

0 8379 0

2024-01-26 05:47:12 UTC

New

General Dev>In The News

Jan: An open source alternative to ChatGPT that runs on the desktop

Jan | Rethink the Computer. Jan turns your computer into an AI machine by running LLMs locally on your computer. It’s a privacy-focus, l...

jan.ai

#desktop #chatgpt

4 5652 4

2024-03-29 08:42:30 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Apple Game Frameworks and Technologies: Screen image may be wrong (p 13)

The Ray Tracer Challenge: "Computing the normal on a transformed sphere" ebook test

Programming Phoenix LiveView: P27, live_path confusion

Python Testing with pytest, Second Edition: cards pip install error (page 12)

Python Testing with pytest, Second Edition: unrecognized arguments error (page 122)

Programming Phoenix LiveView: book not updated to version 1.6 (p. 18)

Hands on Rust: Need help with error - thread 'main' panicked at 'Failed to load texture

The Ray Tracer Challenge: Cannot get rid of acne When implement Shadows in Chapter 8.

Modern Front-End Development for Rails - application does not start after run bin/setup (page xviii)

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)