kai

Programming Machine Learning:

Programming Machine Learning
From Coding to Deep Learning
German edition

Chapter 11
Training the network
Page 191

def back(X, Y, y_hat, w2, h):
w2_gradient = np.matmul(prepend_bias(h).T, y_hat - Y) / X.shape[0]

 a_gradient = np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
 w1_gradient = np.matmul(prepend_bias(X).T, a_gradient) / X.shape[0]

 return (w1_gradient, w2_gradient)

Hi Paolo,
can you explain me how to come to the decision to multiply this expression:
np.matmul(y_hat - Y, w2[1:].T) * sigmoid_gradient(h)
element by element?

Sincerely,
Kai

4 comments

#question /book-programming-machine-learning

1 553 4

2023-10-03 20:36:18 UTC

Most Liked

kai

As I understand it, there is no recipe to derive compositions of functions, whose inputs are matrices, according to them, as it is the case with a scalar.

Thank you for giving me an answer that helped my understanding anyway.

I am fascinated by mathematics and its power. But to be able to see its beauty, it requires a lot of time. That is why I asked such a question.

Your book was recommended to me and declared very worthwhile, which I can confirm 100%. It is my introduction to ML. Thank you for it!

Translated with DeepL Translate: The world's most accurate translator (free version)

Post #5

Where Next?

View thread on forum

View Programming Machine Learning's book portal

Post errata for this book

Post a suggestion for this book

Post a question about this book

Post a review about this book

question

Home PragProg Customers

#question /book-programming-machine-learning

1 553 4

Last post

Popular Pragmatic Bookshelf topics

PragProg Customers

Distributed Services With Go - gogoproto on linux

page 20: … protoc command… I had to additionally run the following go get commands in order to be able to compile protobuf code using go...

#errata /book-distributed-services-with-go

14 2953 7

2020-10-16 05:21:10 UTC

New

PragProg Customers

The Ray Tracer Challenge - where are the errata?

As per the title, thanks.

/book-the-ray-tracer-challenge

6 1681 4

2020-07-16 14:30:43 UTC

New

PragProg Customers

Hands-on Rust: question about get_component

Title: Hands-on Rust: question about get_component (page 295) (feel free to respond. “You dug you’re own hole… good luck”) I have somet...

#question /book-hands-on-rust

1 1167 5

2021-02-01 15:17:34 UTC

New

PragProg Customers

Hands-on Rust: Build depending on bracket-lib fails

Hi, build fails on: bracket-lib = “~0.8.1” when running on Mac Mini M1 Rust version 1.5.0: Compiling winit v0.22.2 error[E0308]: mi...

#question /book-hands-on-rust

1 1218 1

2021-02-14 14:34:19 UTC

New

PragProg Customers

Programming Kotlin: Difference between SupervisorJob() and supervisorScope (324, 325)

Hi @venkats, It has been mentioned in the description of ‘Supervisory Job’ title that 2 things as mentioned below result in the same eff...

#question /book-programming-kotlin

0 2242 2

2021-03-16 11:28:51 UTC

New

PragProg Customers

Programming Phoenix LiveView: errata and remarks Version B2.0

The generated iex result below should list products instead of product for the metadata. (page 67) iex> product = %Product{} %Pento....

#errata /book-programming-phoenix-liveview

0 1800 20

2021-03-23 10:33:03 UTC

New

PragProg Customers

Domain Modeling Made Functional: Missing diagram on page 18

The book has the same “Problem space/Solution space” diagram on page 18 as is on page 17. The correct Problem/Solution space diagrams ar...

#errata /book-domain-modeling-made-functional

1 1078 1

2021-09-11 17:34:22 UTC

New

PragProg Customers

Kotlin and Android Development featuring Jetpack: $kotlin_version ? (page 8)

I’m running Android Studio “Arctic Fox” 2020.3.1 Patch 2, and I’m embarrassed to admit that I only made it to page 8 before running into ...

#errata /book-kotlin-and-android-development-featuring-jetpack

0 1698 3

2021-09-03 21:44:18 UTC

New

PragProg Customers

Python Testing with pytest, Second Edition: error when installing editable package (page 178)

When installing Cards as an editable package, I get the following error: ERROR: File “setup.py” not found. Directory cannot be installe...

#errata /book-python-testing-with-pytest-second-edition

0 1739 1

2021-12-10 05:12:55 UTC

New

PragProg Customers

Machine Learning in Elixir:Error installing EXLA dependency - Page 25

Getting an error when installing the dependencies at the start of this chapter: could not compile dependency :exla, "mix compile" failed...

#errata /book-machine-learning-in-elixir

1 1159 10

2025-01-03 12:05:01 UTC

New

Other popular topics

Backend>Learning Resources

Distributed Services with Go

Take your Go skills to the next level by learning how to design, develop, and deploy a distributed service. Start from the bare essential...

pragprog.com

#pragprog /go #published-book /book-distributed-services-with-go

1 4310 0

2020-04-14 19:05:22 UTC

New

General Dev>Dev Chat

How fast do you type? Check your WPM here!

Do the test and post your score :nerd_face: :keyboard: If possible, please add info such as the keyboard you’re using, the layout (Qw...

typing-speed-test.aoeu.eu

/keyboards

82 7682 31

2021-07-10 05:52:20 UTC

New

Backend>Chat

Using Regular Expressions in Erlang

Intensively researching Erlang books and additional resources on it, I have found that the topic of using Regular Expressions is either c...

/erlang #regular-expressions

91 5662 43

2021-09-06 19:12:48 UTC

New

Backend>Learning Resources

Programming WebRTC

Use WebRTC to build web applications that stream media and data in real time directly from one user to another, all in the browser. ...

pragprog.com

#pragprog #published-book /js #webrtc /book-programming-webrtc

27 6969 6

2021-11-20 19:03:04 UTC

New

General Dev>Dev Chat

Warp—The blazingly fast, Rust-based terminal

A few weeks ago I started using Warp a terminal written in rust. Though in it’s current state of development there are a few caveats (tab...

/rust #terminal

52 6785 22

2025-02-26 17:47:24 UTC

New

General Dev>Code Editors

Doom-Emacs: Can't find emacs in your PATH

If you get Can't find emacs in your PATH when trying to install Doom Emacs on your Mac you… just… need to install Emacs first! :lol: bre...

#macos /emacs #doom-emacs

4 5837 0

2022-02-04 00:32:03 UTC

New

Community>In The Spotlight

Spotlight: VM Brasseur (Author) Interview and AMA!

Author Spotlight: VM Brasseur @vmbrasseur We have a treat for you today! We turn the spotlight onto Open Source as we sit down with V...

#author-spotlight /book-forge-your-future-with-open-source

16 5051 11

2023-03-27 16:00:12 UTC

New

Community>In The Spotlight

Spotlight: Peter Ullrich (Author) Interview and AMA!

Author Spotlight: Peter Ullrich @PJUllrich Data is at the core of every business, but it is useless if nobody can access and analyze ...

/elixir /phoenix /book-building-table-views-with-phoenix-liveview

72 4765 21

2023-10-17 17:07:59 UTC

New

Backend>Learning Resources

Engineering Elixir Applications

Develop, deploy, and debug BEAM applications using BEAMOps: a new paradigm that focuses on scalability, fault tolerance, and owning each ...

pragprog.com

#pragprog /elixir #published-book /book-engineering-elixir-applications

40 7136 21

2024-11-08 15:13:02 UTC

New

Backend>Learning Resources

Agile Web Development with Rails 8

Get the comprehensive, insider information you need for Rails 8 with the new edition of this award-winning classic. Sam Ruby @rubys ...

pragprog.com

#pragprog #web-development /ruby /rails #published-book /book-agile-web-development-with-rails-8

12 7404 7

2025-03-27 18:33:39 UTC

New

Programming Machine Learning:

kai

Programming Machine Learning:

Most Liked

kai

Where Next?

Popular Pragmatic Bookshelf topics

Distributed Services With Go - gogoproto on linux

The Ray Tracer Challenge - where are the errata?

Hands-on Rust: question about get_component

Hands-on Rust: Build depending on bracket-lib fails

Programming Kotlin: Difference between SupervisorJob() and supervisorScope (324, 325)

Programming Phoenix LiveView: errata and remarks Version B2.0

Domain Modeling Made Functional: Missing diagram on page 18

Kotlin and Android Development featuring Jetpack: $kotlin_version ? (page 8)

Python Testing with pytest, Second Edition: error when installing editable package (page 178)

Machine Learning in Elixir:Error installing EXLA dependency - Page 25