kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

The Definitive ANTLR 4 Reference: Program deprecation warning

page 37 ANTLRInputStream input = new ANTLRInputStream(is); as of ANTLR 4 .8 should be: CharStream stream = CharStreams.fromStream(i...

#errata /book-the-definitive-antlr-4-reference

4 987 0

2020-07-05 23:04:12 UTC

New

PragProg Customers

Hands-on Rust: Build depending on bracket-lib fails

Hi, build fails on: bracket-lib = “~0.8.1” when running on Mac Mini M1 Rust version 1.5.0: Compiling winit v0.22.2 error[E0308]: mi...

#question /book-hands-on-rust

1 1218 1

2021-02-14 14:34:19 UTC

New

PragProg Customers

Intuitive Python: docker run… denied error (page 2)

Title: Intuitive Python: docker run… denied error (page 2) Attempted to run the docker command in both CLI and Powershell PS C:\Users\r...

#errata /book-intuitive-python

9 1263 4

2021-04-06 16:33:24 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: cards pip install error (page 12)

#book-python-testing-with-pytest-second-edition Hi. Thanks for writing the book. I am just learning so this might just of been an issue ...

#errata /book-python-testing-with-pytest-second-edition

4 1191 3

2021-07-03 13:40:39 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: unrecognized arguments error (page 122)

When I run the coverage example to report on missing lines, I get: pytest --cov=cards --report=term-missing ch7 ERROR: usage: pytest [op...

#errata /book-python-testing-with-pytest-second-edition

0 4000 1

2021-12-03 05:36:38 UTC

New

PragProg Customers

Hands-on Rust: Failed to Load Texture error (page 121)

Hi, I completed chapter 6 but am getting the following error when running: thread 'main' panicked at 'Failed to load texture: IoError(O...

/book-hands-on-rust

2 1310 3

2022-01-23 22:36:50 UTC

New

PragProg Customers

Agile Web Development with Rails 7: Reloading assets in development mode

Hi all, currently I wonder how the Tailwind colours work (or don’t work). For example, in app/views/layouts/application.html.erb I have...

#question /book-agile-web-development-with-rails-7

2 1380 4

2022-02-18 10:00:49 UTC

New

PragProg Customers

Hands-on Rust: How do I debug a call chain in Rust?

When running the program in chapter 8, “Implementing Combat”, the printout Health before attack was never printed so I assumed something ...

#question /book-hands-on-rust

2 1034 2

2022-07-14 12:23:33 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: Unique constraint error when running chapter 5 code changes

@mfazio23 I’ve applied the changes from Chapter 5 of the book and everything builds correctly and runs. But, when I try to start a game,...

/book-kotlin-and-android-development-featuring-jetpack

0 1180 10

2023-08-07 20:43:16 UTC

New

PragProg Customers

Bug with dx/build - how to workaround until fix is up

Hello faithful readers! If you have tried to follow along in the book, you are asked to start up the dev environment via dx/build and ar...

#errata /book-ruby-on-rails-background-jobs-with-sidekiq

3 1178 19

2024-01-23 22:22:16 UTC

New

Other popular topics

Community>Journals

Programming Erlang Book Club

My first contact with Erlang was about 2 years ago when I used RabbitMQ, which is written in Erlang, for my job. This made me curious and...

/erlang /book-programming-erlang-2nd-edition #book-club

195 6815 95

2025-02-16 20:22:17 UTC

New

Game Dev>Learning Resources

Hands-on Rust: Effective Learning through 2D Game Development and Play

Rust is an exciting new programming language combining the power of C with memory safety, fearless concurrency, and productivity boosters...

pragprog.com

#pragprog /rust #published-book /book-hands-on-rust

117 10879 30

2024-11-09 13:24:20 UTC

New

General Dev>Code Editors

Dendron: a personal knowledge management tool on top of VSCode

/vscode #visual-studio-code

30 7372 9

2021-05-05 12:15:29 UTC

New

Backend>Questions

Erlang's not installing on macOS Big Sur "You are natively building Erlang/OTP for a later version of MacOSX than current version"

Just done a fresh install of macOS Big Sur and on installing Erlang I am getting: asdf install erlang 23.1.2 Configure failed. checking ...

#macos /erlang #big-sur #asdf

10 6212 8

2021-01-16 12:33:23 UTC

New

Frontend>Learning Resources

Modern CSS with Tailwind

Tailwind CSS is an exciting new CSS framework that allows you to design your site by composing simple utility classes to create complex e...

pragprog.com

#pragprog /tailwind #published-book /book-modern-css-with-tailwind

12 5813 4

2021-05-13 14:50:23 UTC

New

Backend>Learning Resources

Concurrent Data Processing in Elixir

Learn different ways of writing concurrent code in Elixir and increase your application's performance, without sacrificing scalability or...

pragprog.com

#pragprog /elixir #published-book /book-concurrent-data-processing-in-elixir

78 6059 24

2021-09-04 12:35:42 UTC

New

Backend>Learning Resources

Programming Phoenix LiveView

Build highly interactive applications without ever leaving Elixir, the way the experts do. Let LiveView take care of performance, scalabi...

pragprog.com

#pragprog /elixir /phoenix #published-book /book-programming-phoenix-liveview

79 10732 24

2026-02-13 05:37:02 UTC

New

Community>In The Spotlight

Spotlight: Rebecca Skinner (Author) Interview and AMA!

Author Spotlight Rebecca Skinner @RebeccaSkinner Welcome to our latest author spotlight, where we sit down with Rebecca Skinner, auth...

#author-spotlight /haskell /book-effective-haskell

106 11719 28

2022-11-16 10:29:37 UTC

New

General Dev>In The News

Zig now has built-in HTTP server and client in std

zig/http.zig at 7cf2cbb33ef34c1d211135f56d30fe23b6cacd42 · ziglang/zig. General-purpose programming language and toolchain for maintaini...

github.com

/zig #http

0 5624 0

2023-05-19 00:35:41 UTC

New

Backend>Official News

Node.js v22.14.0 released!

Node.js v22.14.0 has been released. Link: Release 2025-02-11, Version 22.14.0 'Jod' (LTS), @aduh95 · nodejs/node · GitHub

github.com

/nodejs #official-news

0 4251 0

2025-02-11 15:30:14 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

The Definitive ANTLR 4 Reference: Program deprecation warning

Hands-on Rust: Build depending on bracket-lib fails

Intuitive Python: docker run… denied error (page 2)

Python Testing with pytest, Second Edition: cards pip install error (page 12)

Python Testing with pytest, Second Edition: unrecognized arguments error (page 122)

Hands-on Rust: Failed to Load Texture error (page 121)

Agile Web Development with Rails 7: Reloading assets in development mode

Hands-on Rust: How do I debug a call chain in Rust?

Kotlin and Android Development featuring Jetpack: Unique constraint error when running chapter 5 code changes

Bug with dx/build - how to workaround until fix is up