kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Effective Testing with RSpec 3: Running Sequel migrations fails (page 84)

Following the steps described in Chapter 6 of the book, I’m stuck with running the migration as described on page 84: bundle exec sequel...

#errata /book-effective-testing-with-rspec-3

4 1152 1

2020-07-16 15:18:25 UTC

New

PragProg Customers

Programming Flutter: Image.toByteData() does not exist (page40)

your book suggests to use Image.toByteData() to convert image to bytes, however I get the following error: "the getter ‘toByteData’ isn’t...

/book-programming-flutter #question

1 4102 2

2021-02-23 16:03:08 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition: (create-migration "guestbook") not working (page 9)

When I try the command to create a pair of migration files I get an error. user=> (create-migration "guestbook") Execution error (Ill...

#errata /book-web-development-with-clojure-third-edition

5 1788 4

2023-07-27 14:17:36 UTC

New

PragProg Customers

Hands-on Rust: can_place logic is "inside out"

Title: Hands-On Rust (Chapter 11: prefab) Just played a couple of amulet-less games. With a bit of debugging, I believe that your can_p...

#errata /book-hands-on-rust

22 1628 20

2022-03-29 12:23:50 UTC

New

PragProg Customers

Distributed Services with Go: Chapter 3 suggestions

Page 28: It implements io.ReaderAt on the store type. Sorry if it’s a dumb question but was the io.ReaderAt supposed to be io.ReadAt? ...

#errata /book-distributed-services-with-go

0 1302 3

2022-07-27 14:35:18 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: cards pip install error (page 12)

#book-python-testing-with-pytest-second-edition Hi. Thanks for writing the book. I am just learning so this might just of been an issue ...

#errata /book-python-testing-with-pytest-second-edition

4 1191 3

2021-07-03 13:40:39 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: File not Found Error (page 43)

I ran this command after installing the sample application: $ cards add do something --owner Brian And got a file not found error: Fil...

#errata /book-python-testing-with-pytest-second-edition

5 4391 7

2021-07-03 13:51:08 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: Error in generated Game.java (page 136)

I’m under the impression that when the reader gets to page 136 (“View Data with the Database Inspector”), the code SHOULD be able to buil...

#question /book-kotlin-and-android-development-featuring-jetpack

2 1172 8

2021-09-17 18:06:54 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition:Abou epub format

Is the book’s epub format available to read on Google Play Books?

#question /book-python-testing-with-pytest-second-edition

0 1126 3

2022-01-20 20:47:42 UTC

New

PragProg Customers

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)

root_layout: {PentoWeb.LayoutView, :root}, This results in the following following error: no “root” html template defined for PentoWeb...

#errata /book-programming-phoenix-liveview

8 1094 4

2023-10-22 17:25:26 UTC

New

Other popular topics

General Dev>Learning Resources

Seven More Languages in Seven Weeks

Learn from the award-winning programming series that inspired the Elixir language, and go on a step-by-step journey through the most impo...

pragprog.com

#pragprog /elixir /julia /lua #published-book #factor /elm #minikanren /idris /book-seven-more-languages-in-seven-weeks

4 5862 0

2020-04-29 21:59:54 UTC

New

Backend>Chat

What is the reason behind Rust’s web framework, Rocket, not performing as well as expected in the Techempower benchmarks?

I know that these benchmarks might not be the exact picture of real-world scenario, but still I expect a Rust web framework performing a ...

#web-frameworks /rust

36 7463 11

2020-06-21 10:50:02 UTC

New

General Dev>Hardware

What monitor(s) do you have for programming?

Please tell us what is your preferred monitor setup for programming(not gaming) and why you have chosen it. Does your monitor have eye p...

#monitors #coding #programming #development

227 11362 88

2022-02-01 12:02:08 UTC

New

Game Dev>Learning Resources

Apple Game Frameworks and Technologies

Design and develop sophisticated 2D games that are as much fun to make as they are to play. From particle effects and pathfinding to soci...

pragprog.com

#pragprog #ios #game-dev #macos /swift #published-book #apple /book-apple-game-frameworks-and-technologies

30 7995 10

2021-04-22 16:51:02 UTC

New

Community>Journals

Programming Erlang Book Club

My first contact with Erlang was about 2 years ago when I used RabbitMQ, which is written in Erlang, for my job. This made me curious and...

/erlang /book-programming-erlang-2nd-edition #book-club

195 6815 95

2025-02-16 20:22:17 UTC

New

Game Dev>Learning Resources

Hands-on Rust: Effective Learning through 2D Game Development and Play

Rust is an exciting new programming language combining the power of C with memory safety, fearless concurrency, and productivity boosters...

pragprog.com

#pragprog /rust #published-book /book-hands-on-rust

117 10879 30

2024-11-09 13:24:20 UTC

New

Backend>Questions

Erlang's not installing on macOS Big Sur "You are natively building Erlang/OTP for a later version of MacOSX than current version"

Just done a fresh install of macOS Big Sur and on installing Erlang I am getting: asdf install erlang 23.1.2 Configure failed. checking ...

#macos /erlang #big-sur #asdf

10 6212 8

2021-01-16 12:33:23 UTC

New

Linux>Chat

RancherOS is in end of life

Oh just spent so much time on this to discover now that RancherOS is in end of life but Rancher is refusing to mark the Github repo as su...

#linux #rancheros

10 6358 6

2021-01-30 21:04:03 UTC

New

macOS>Chat

How to block any website on Mac using Little Snitch

If you want a quick and easy way to block any website on your Mac using Little Snitch simply… File > New Rule: And select Deny, O...

#macos #how-to #littlesnitch

5 11227 3

2022-07-05 00:59:40 UTC

New

Backend>Learning Resources

Simplicity

Fight complexity and reclaim the original spirit of agility by learning to simplify how you develop software. The result: a more humane a...

pragprog.com

#pragprog #published-book /book-simplicity

10 6553 8

2025-03-14 21:53:12 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Effective Testing with RSpec 3: Running Sequel migrations fails (page 84)

Programming Flutter: Image.toByteData() does not exist (page40)

Web Development with Clojure, Third Edition: (create-migration "guestbook") not working (page 9)

Hands-on Rust: can_place logic is "inside out"

Distributed Services with Go: Chapter 3 suggestions

Python Testing with pytest, Second Edition: cards pip install error (page 12)

Python Testing with pytest, Second Edition: File not Found Error (page 43)

Kotlin and Android Development featuring Jetpack: Error in generated Game.java (page 136)

Python Testing with pytest, Second Edition:Abou epub format

Programming Phoenix LiveView: PentoWeb.LayoutView errata (56)