kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

The Pragmatic Programmer, 20th Anniversary Edition errata

Some minor things in the paper edition that says “3 2020” on the title page verso, not mentioned in the book’s errata online: p. 186 But...

#errata /book-the-pragmatic-programmer-20th-anniversary-edition

10 2636 9

2024-09-02 13:34:40 UTC

New

PragProg Customers

Effective Testing with RSpec 3: Running Sequel migrations fails (page 84)

Following the steps described in Chapter 6 of the book, I’m stuck with running the migration as described on page 84: bundle exec sequel...

#errata /book-effective-testing-with-rspec-3

4 1152 1

2020-07-16 15:18:25 UTC

New

PragProg Customers

Modern Front-End Development for Rails: Can't get TURBO_STREAM format in some cases

This isn’t directly about the book contents so maybe not the right forum…but in some of the code apps (e.g. turbo/06) it sends a TURBO_ST...

#question /book-modern-front-end-development-for-rails

1 1386 7

2021-04-04 21:22:11 UTC

New

PragProg Customers

Modern Front-End Development for Rails: ERROR in tsconfig.json Chapter_01/01

@noelrappin Running the webpack dev server, I receive the following warning: ERROR in tsconfig.json TS18003: No inputs were found in c...

/book-modern-front-end-development-for-rails

3 1438 3

2021-09-02 19:11:59 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: $kotlin_version ? (page 8)

I’m running Android Studio “Arctic Fox” 2020.3.1 Patch 2, and I’m embarrassed to admit that I only made it to page 8 before running into ...

#errata /book-kotlin-and-android-development-featuring-jetpack

0 1698 3

2021-09-03 21:44:18 UTC

New

PragProg Customers

Programming Phoenix LiveView: live_modal/2 instead of live_component/3 (210)

“The ProductLive.Index template calls a helper function, live_component/3, that in turn calls on the modal component. ” Excerpt From: Br...

#errata /book-programming-phoenix-liveview

3 1042 6

2021-11-03 12:30:33 UTC

New

PragProg Customers

The Ray Tracer Challenge: cannot pass scaling test (page 69-70)

The test is as follows: Scenario: Intersecting a scaled sphere with a ray Given r ← ray(point(0, 0, -5), vector(0, 0, 1)) And s ← sphere...

#question /book-the-ray-tracer-challenge

1 1093 4

2022-07-27 09:47:44 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: InterpreterNotFound error when running tox (page 150)

When running tox for the first time, I got the following error: ERROR: InterpreterNotFound: python3.10 I realised that I was running ...

#errata /book-python-testing-with-pytest-second-edition

0 1306 1

2021-12-10 05:06:56 UTC

New

PragProg Customers

Programming Phoenix LiveView: Display Image Uploads (pdf p142)

The markup used to display the uploaded image results in a Phoenix.LiveView.HTMLTokenizer.ParseError error. lib/pento_web/live/product_l...

#errata /book-programming-phoenix-liveview

2 2102 9

2022-07-05 17:58:54 UTC

New

PragProg Customers

Real Time Phoenix Errata P17: Getting first sample working with Phoenix 1.6.x

Skimming ahead, much of the following is explained in Chapter 3, but new readers (like me!) will hit a roadblock in Chapter 2 with their ...

#errata /book-real-time-phoenix

6 1116 5

2022-12-08 12:49:23 UTC

New

Other popular topics

Backend>Learning Resources

Programming Machine Learning

Machine learning can be intimidating, with its reliance on math and algorithms that most programmers don't encounter in their regular wor...

pragprog.com

#pragprog #ai /python #published-book /book-programming-machine-learning #math #algorithms

6 5350 3

2023-10-03 15:08:13 UTC

New

Backend>Questions

Erlang's not installing on macOS Big Sur "You are natively building Erlang/OTP for a later version of MacOSX than current version"

Just done a fresh install of macOS Big Sur and on installing Erlang I am getting: asdf install erlang 23.1.2 Configure failed. checking ...

#macos /erlang #big-sur #asdf

10 6212 8

2021-01-16 12:33:23 UTC

New

General Dev>Dev Chat

How fast do you type? Check your WPM here!

Do the test and post your score :nerd_face: :keyboard: If possible, please add info such as the keyboard you’re using, the layout (Qw...

typing-speed-test.aoeu.eu

/keyboards

82 7682 31

2021-07-10 05:52:20 UTC

New

Backend>Chat

Data Structures and Algorithms with Elixir

This is going to be a long an frequently posted thread. While talking to a friend of mine who has taken data structure and algorithm cou...

/elixir #algorithms #data-structures

108 11869 31

2024-11-14 02:14:00 UTC

New

Science/Tech>Health & Diet

David Sinclair's new Lifespan podcast

We’ve talked about his book briefly here but it is quickly becoming obsolete - so he’s decided to create a series of 7 podcasts, the firs...

#health #podcasts #bio-hackers #david-sinclair

87 6790 49

2022-04-12 16:27:36 UTC

New

Windows>Chat

Taskbar Overflow Menu (NOT System Tray Overflow)

There appears to have been an update that has changed the terminology for what has previously been known as the Taskbar Overflow - this h...

#taskbar-overflow-win-11

3 3715 2

2023-02-13 08:43:55 UTC

New

General Dev>In The News

Zig now has built-in HTTP server and client in std

zig/http.zig at 7cf2cbb33ef34c1d211135f56d30fe23b6cacd42 · ziglang/zig. General-purpose programming language and toolchain for maintaini...

github.com

/zig #http

0 5624 0

2023-05-19 00:35:41 UTC

New

General Dev>Learning Resources

A Common-Sense Guide to Data Structures and Algorithms in Python, Volume 1

Big O Notation can make your code faster by orders of magnitude. Get the hands-on info you need to master data structures and algorithms ...

pragprog.com

#pragprog /python #published-book /book-a-common-sense-guide-to-data-structures-and-algorithms-in-python-volume-1

24 5988 11

2024-01-29 15:52:29 UTC

New

Android>Questions

Unresolved Reference to android in build.gradle.kts – Beginner Issue

Hello, I’m a beginner in Android development and I’m facing an issue with my project setup. In my build.gradle.kts file, I have the foll...

#binding

0 7460 2

2024-12-09 21:07:33 UTC

New

Backend>Learning Resources

Ash Framework

Explore the power of Ash Framework by modeling and building the domain for a real-world web application. Rebecca Le @sevenseacat and ...

pragprog.com

#pragprog /elixir #published-book /ash /book-ash-framework

15 7555 9

2025-02-06 12:19:21 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

The Pragmatic Programmer, 20th Anniversary Edition errata

Effective Testing with RSpec 3: Running Sequel migrations fails (page 84)

Modern Front-End Development for Rails: Can't get TURBO_STREAM format in some cases

Modern Front-End Development for Rails: ERROR in tsconfig.json Chapter_01/01

Kotlin and Android Development featuring Jetpack: $kotlin_version ? (page 8)

Programming Phoenix LiveView: live_modal/2 instead of live_component/3 (210)

The Ray Tracer Challenge: cannot pass scaling test (page 69-70)

Python Testing with pytest, Second Edition: InterpreterNotFound error when running tox (page 150)

Programming Phoenix LiveView: Display Image Uploads (pdf p142)

Real Time Phoenix Errata P17: Getting first sample working with Phoenix 1.6.x