kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Distributed Services With Go - gogoproto on linux

page 20: … protoc command… I had to additionally run the following go get commands in order to be able to compile protobuf code using go...

#errata /book-distributed-services-with-go

14 2953 7

2020-10-16 05:21:10 UTC

New

PragProg Customers

Python Testing with pytest: pytest now requires markers to be declared (downloadable code)

Many tasks_proj/tests directories exist in chapters 2, 3, 5 that have tests that use the custom markers smoke and get, which are not decl...

#errata /book-python-testing-with-pytest

2 1383 2

2021-02-16 14:15:02 UTC

New

PragProg Customers

Web Development with Clojure, Third Edition: Issue adding Shadow CLJS

Title: Web Development with Clojure, Third Edition, pg 116 Hi - I just started chapter 5 and I am stuck on page 116 while trying to star...

#question /book-web-development-with-clojure-third-edition

4 1199 4

2021-01-10 05:30:17 UTC

New

PragProg Customers

The Cucumber for Java Book:

Hello! On page xix of the preface, it says there is a community forum "… for help if your’re stuck on one of the exercises in this book… ...

#question /book-the-cucumber-for-java-book

3 1143 1

2021-01-12 18:03:10 UTC

New

PragProg Customers

Programming Phoenix LiveView: Typo

Hi! I know not the intentions behind this narrative when called, on page XI: mount() |> handle_event() |> render() but the correc...

#errata /book-programming-phoenix-liveview

3 1307 17

2021-03-11 16:34:20 UTC

New

PragProg Customers

Modern Front-End Development for Rails: ERROR in tsconfig.json Chapter_01/01

@noelrappin Running the webpack dev server, I receive the following warning: ERROR in tsconfig.json TS18003: No inputs were found in c...

/book-modern-front-end-development-for-rails

3 1438 3

2021-09-02 19:11:59 UTC

New

PragProg Customers

Real Time Phoenix Errata P17: Getting first sample working with Phoenix 1.6.x

Skimming ahead, much of the following is explained in Chapter 3, but new readers (like me!) will hit a roadblock in Chapter 2 with their ...

#errata /book-real-time-phoenix

6 1116 5

2022-12-08 12:49:23 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: Transformations class doesn't seem to exist anymore (pp. 140-141

@mfazio23 Android Studio will not accept anything I do when trying to use the Transformations class, as described on pp. 140-141. Googl...

#errata /book-kotlin-and-android-development-featuring-jetpack

0 2155 5

2023-10-01 15:02:47 UTC

New

PragProg Customers

Programming Machine Learning: Setting up your system (p 13)

From page 13: On Python 3.7, you can install the libraries with pip by running these commands inside a Python venv using Visual Studio ...

#question /book-programming-machine-learning

1 989 3

2023-10-09 07:44:15 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: End Ch. 11 app runs but consistently crashes

I’ve got to the end of Ch. 11, and the app runs, with all tabs displaying what they should – at first. After switching around between St...

#question /book-kotlin-and-android-development-featuring-jetpack

0 936 8

2024-01-05 05:43:55 UTC

New

Other popular topics

Backend>Learning Resources

Distributed Services with Go

Take your Go skills to the next level by learning how to design, develop, and deploy a distributed service. Start from the bare essential...

pragprog.com

#pragprog /go #published-book /book-distributed-services-with-go

1 4310 0

2020-04-14 19:05:22 UTC

New

General Dev>Learning Resources

A Common-Sense Guide to Data Structures and Algorithms, Second Edition

Algorithms and data structures are much more than abstract concepts. Mastering them enables you to write code that runs faster and more e...

pragprog.com

#pragprog /python /ruby #published-book /book-a-common-sense-guide-to-data-structures-and-algorithms-second-edition #math #algorithms /js

19 6022 5

2020-08-14 00:58:37 UTC

New

General Dev>Dev Chat

Which language or framework do you want to learn next?

Curious to know which languages and frameworks you’re all thinking about learning next :upside_down_face: Perhaps if there’s enough peop...

#community #learning

243 6639 97

2025-12-01 07:17:12 UTC

New

General Dev>Hardware

BIIP MT3 Extended 2048 Custom Keycap Set (Drop)

This looks like a stunning keycap set :orange_heart: A LEGENDARY KEYBOARD LIVES ON When you bought an Apple Macintosh computer in the e...

/keyboards #apple #keycaps #mechanical-keyboards

14 6713 7

2020-12-12 19:58:26 UTC

New

Backend>Learning Resources

Agile Web Development with Rails 7

Rails 7 completely redefines what it means to produce fantastic user experiences and provides a way to achieve all the benefits of single...

pragprog.com

#pragprog #web-development /ruby /rails #published-book /book-agile-web-development-with-rails-7

32 6600 9

2022-01-26 18:28:44 UTC

New

General Dev>Code Editors

Doom-Emacs: Can't find emacs in your PATH

If you get Can't find emacs in your PATH when trying to install Doom Emacs on your Mac you… just… need to install Emacs first! :lol: bre...

#macos /emacs #doom-emacs

4 5837 0

2022-02-04 00:32:03 UTC

New

General Dev>Learning Resources

A Common-Sense Guide to Data Structures and Algorithms in Python, Volume 1

Big O Notation can make your code faster by orders of magnitude. Get the hands-on info you need to master data structures and algorithms ...

pragprog.com

#pragprog /python #published-book /book-a-common-sense-guide-to-data-structures-and-algorithms-in-python-volume-1

24 5988 11

2024-01-29 15:52:29 UTC

New

Game Dev>Questions

I want to learn how make a game, but where should I start?

I’m able to do the “artistic” part of game-development; character designing/modeling, music, environment modeling, etc. However, I don’t...

#game-dev

15 4965 9

2025-10-18 13:12:58 UTC

New

Backend>Learning Resources

Agile Web Development with Rails 8

Get the comprehensive, insider information you need for Rails 8 with the new edition of this award-winning classic. Sam Ruby @rubys ...

pragprog.com

#pragprog #web-development /ruby /rails #published-book /book-agile-web-development-with-rails-8

12 7404 7

2025-03-27 18:33:39 UTC

New

Backend>Official News

Node.js v22.14.0 released!

Node.js v22.14.0 has been released. Link: Release 2025-02-11, Version 22.14.0 'Jod' (LTS), @aduh95 · nodejs/node · GitHub

github.com

/nodejs #official-news

0 4251 0

2025-02-11 15:30:14 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Distributed Services With Go - gogoproto on linux

Python Testing with pytest: pytest now requires markers to be declared (downloadable code)