kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

The Ray Tracer Challenge - where are the errata?

As per the title, thanks.

/book-the-ray-tracer-challenge

6 1681 4

2020-07-16 14:30:43 UTC

New

PragProg Customers

Effective Testing with RSpec 3: Running Sequel migrations fails (page 84)

Following the steps described in Chapter 6 of the book, I’m stuck with running the migration as described on page 84: bundle exec sequel...

#errata /book-effective-testing-with-rspec-3

4 1152 1

2020-07-16 15:18:25 UTC

New

PragProg Customers

Hands-On Rust: Wrong multiplier for 8x8 console in main.rs

Title: Hands-On Rust (Chap 8 (Adding a Heads Up Display) It looks like .with_simple_console_no_bg(SCREEN_WIDTH*2, SCREEN_HEIGHT*2...

#errata /book-hands-on-rust

9 2026 5

2022-02-15 14:09:12 UTC

New

PragProg Customers

Hands-on Rust: can_place logic is "inside out"

Title: Hands-On Rust (Chapter 11: prefab) Just played a couple of amulet-less games. With a bit of debugging, I believe that your can_p...

#errata /book-hands-on-rust

22 1628 20

2022-03-29 12:23:50 UTC

New

PragProg Customers

Docker for Rails Developers: Notes for Rails 6.1, Ruby 2.7.2

I thought that there might be interest in using the book with Rails 6.1 and Ruby 2.7.2. I’ll note what I needed to do differently here. ...

/book-docker-for-rails-developers

9 1177 1

2021-01-03 20:41:43 UTC

New

PragProg Customers

Modern CSS with Tailwind: can’t setup the Rails source code

I can’t setup the Rails source code. This happens in a working directory containing multiple (postgres) Rails apps. With: ruby-3.0.0 s...

#question /book-modern-css-with-tailwind

0 1280 3

2021-03-27 15:29:34 UTC

New

PragProg Customers

Real-Time Phoenix: ProductChannelTest - undefined function describe/2 (pg 203)

Hi, I am getting an error I cannot figure out on my test. I have what I think is the exact code from the book, other than I changed “us...

#question /book-real-time-phoenix

0 1775 6

2022-02-16 19:15:15 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: allprojects should be moved to settings.gradle (page 245)

The allprojects block listed on page 245 produces the following error when syncing gradle: “org.gradle.api.GradleScriptException: A prob...

#suggestion /book-kotlin-and-android-development-featuring-jetpack

1 2304 1

2022-02-26 23:52:12 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: error concerning function getCurrentStandings in BaseballDao.java

@mfazio23 I’m following the indications of the book and arriver ad chapter 10, but the app cannot be compiled due to an error in the Bas...

#question /book-kotlin-and-android-development-featuring-jetpack

1 3397 6

2022-07-22 14:06:06 UTC

New

PragProg Customers

Hands-on Rust: Chapter 3: Can't get first hello to run

Hello @herbert ! Trying to get the very first “Hello, Bracket Terminal!" example to run (p. 53). I develop on an Amazon EC2 instance runn...

#question /book-hands-on-rust

0 1147 2

2025-01-07 19:49:45 UTC

New

Other popular topics

General Dev>Dev Chat

Standing Desks

No chair. I have a standing desk. This post was split into a dedicated thread from our thread about chairs :slight_smile:

#workspace #opinions

177 9554 77

2022-09-27 18:40:05 UTC

New

Backend>Learning Resources

Concurrent Data Processing in Elixir

Learn different ways of writing concurrent code in Elixir and increase your application's performance, without sacrificing scalability or...

pragprog.com

#pragprog /elixir #published-book /book-concurrent-data-processing-in-elixir

78 6059 24

2021-09-04 12:35:42 UTC

New

Data Science

Can AI/ML predict a lottery win?

Biggest jackpot ever apparently! :upside_down_face: I don’t (usually) gamble/play the lottery, but working on a program to predict the...

#ai #machine-learning

19 3939 10

2021-10-18 19:01:41 UTC

New

Community>In The Spotlight

Spotlight: Dmitry Zinoviev (Author) Interview and AMA!

Author Spotlight Dmitry Zinoviev @aqsaqal Today we’re putting our spotlight on Dmitry Zinoviev, author of Data Science Essentials in ...

#author-spotlight /python /book-complex-network-analysis-in-python /book-data-science-essentials-in-python /book-resourceful-code-reuse /book-pythonic-programming

33 5211 14

2022-10-11 20:07:10 UTC

New

Community>In The Spotlight

Spotlight: Erin Dees (Author) Interview and AMA!

Author Spotlight Erin Dees @undees Welcome to our new author spotlight! We had the pleasure of chatting with Erin Dees, co-author of ...

#author-spotlight /ruby /rails /book-effective-testing-with-rspec-3 /book-seven-more-languages-in-seven-weeks /book-cucumber-recipes #rspec

24 4247 11

2023-03-27 15:52:01 UTC

New

Backend>Learning Resources

Engineering Elixir Applications

Develop, deploy, and debug BEAM applications using BEAMOps: a new paradigm that focuses on scalability, fault tolerance, and owning each ...

pragprog.com

#pragprog /elixir #published-book /book-engineering-elixir-applications

40 7136 21

2024-11-08 15:13:02 UTC

New

Game Dev>Questions

I want to learn how make a game, but where should I start?

I’m able to do the “artistic” part of game-development; character designing/modeling, music, environment modeling, etc. However, I don’t...

#game-dev

15 4965 9

2025-10-18 13:12:58 UTC

New

Backend>Learning Resources

Ash Framework

Explore the power of Ash Framework by modeling and building the domain for a real-world web application. Rebecca Le @sevenseacat and ...

pragprog.com

#pragprog /elixir #published-book /ash /book-ash-framework

15 7555 9

2025-02-06 12:19:21 UTC

New

Backend>Official News

Node.js v22.14.0 released!

Node.js v22.14.0 has been released. Link: Release 2025-02-11, Version 22.14.0 'Jod' (LTS), @aduh95 · nodejs/node · GitHub

github.com

/nodejs #official-news

0 4251 0

2025-02-11 15:30:14 UTC

New

Game Dev>Chat

Hair Salon Games for Girls Fun

Hair Salon Games for Girls Fun Girls Hair Saloon game is mainly developed for kids. This game allows users to select virtual avatars to ...

#ios #android #unity #fun

2 3556 1

2025-02-27 10:48:33 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

The Ray Tracer Challenge - where are the errata?

Effective Testing with RSpec 3: Running Sequel migrations fails (page 84)

Hands-On Rust: Wrong multiplier for 8x8 console in main.rs

Hands-on Rust: can_place logic is "inside out"

Docker for Rails Developers: Notes for Rails 6.1, Ruby 2.7.2

Modern CSS with Tailwind: can’t setup the Rails source code

Real-Time Phoenix: ProductChannelTest - undefined function describe/2 (pg 203)

Kotlin and Android Development featuring Jetpack: allprojects should be moved to settings.gradle (page 245)

Kotlin and Android Development featuring Jetpack: error concerning function getCurrentStandings in BaseballDao.java

Hands-on Rust: Chapter 3: Can't get first hello to run