ManningBooks

ManningBooks

Devtalk Sponsor

Grokking Parallel Programming (Manning)

Parallel programming has become essential to everything from AI and scientific computing to image processing, but learning it can still feel like being dropped into the deep end of threads, memory, and unfamiliar GPU terminology.

SungHwan Yun

Grokking Parallel Programming: With Examples in CUDA by SungHwan Yun takes a much friendlier route. It starts with a question that matters: how do you stop thinking sequentially and learn to recognize work that can happen at the same time?

The book uses visual explanations, approachable analogies, and small CUDA programs to build that way of thinking from the ground up. You’ll learn how to:

• Write and launch your first CUDA kernels
• Organize work across threads, blocks, and grids
• Move data safely between the CPU and GPU
• Recognize reusable patterns such as Map and Reduction
• Avoid race conditions and out-of-bounds memory access
• Understand when parallelization will help—and when it won’t

One detail I particularly like is that you don’t need to own an NVIDIA GPU to begin. The exercises run in a free browser-based lab, so anyone comfortable with basic C functions and loops can start experimenting with actual CUDA code.

Five chapters are currently available through Manning’s Early Access Program. Because it’s a MEAP, readers can follow the book as it develops, receive new chapters as they’re released, and send feedback that can help shape the finished edition.

If you’ve been curious about what happens underneath frameworks such as PyTorch and TensorFlow—or you simply want to develop a better instinct for designing parallel algorithms—this is a practical place to start.


Don’t forget you can get 45% off with your Devtalk discount! Just use the coupon code “devtalk.com” at checkout :+1:

Most Liked

alvinkatojr

alvinkatojr

Ok, this one looks FIRE! :fire: :fire: :fire:

And I don’t even need an NVIDIA GPU?! :exploding_head:

Way to go Manning!

jss

jss

Yup, book looks interesting, but I haven’t done C programming for more than a decade.

Where Next?

Popular Frontend topics Top

PragmaticBookshelf
Dive right into React by defining components, the basic building blocks of a React application. Ludovico Fischer @ludofischer Edite...
New
PragmaticBookshelf
Design and code JavaScript applications with automated tests. Fire up your editor and get hands-on through practical exercises for effect...
New
PragmaticBookshelf
Design websites faster than ever using Sass—the most mature and popular CSS meta-language. Code the right way in Sass with short, clear e...
New
AstonJ
They now have a beginners course on NodeJS, following their beginners course on Javascript. I’m hoping they will do one o...
New
PragmaticBookshelf
This new edition of the book covers Tailwind 3.0, which changes the way Tailwind generates its CSS. Tailwind 3.0 has a large number of ne...
New
ManningBooks
Lean Software Engineering: Fix the system, not the code introduces an AI-aware systems thinking approach adapted for the modern software ...
New
New
ManningBooks
In Web Component Development with Modern Libraries and Tooling, you’ll learn how to build reusable web components that last well beyond t...
New
ManningBooks
Architecting Accessibility shows you how to build web applications that work for everyone. Rather than treating accessibility as a checkl...
New
ManningBooks
Parallel programming has become essential to everything from AI and scientific computing to image processing, but learning it can still f...
New

Other popular topics Top

PragmaticBookshelf
Instantly view the changes you make to an app with stateful hot reload, and define a declarative UI in the same language as the app logic...
New
Exadra37
Please tell us what is your preferred monitor setup for programming(not gaming) and why you have chosen it. Does your monitor have eye p...
New
PragmaticBookshelf
From finance to artificial intelligence, genetic algorithms are a powerful tool with a wide array of applications. But you don't need an ...
New
AstonJ
Do the test and post your score :nerd_face: :keyboard: If possible, please add info such as the keyboard you’re using, the layout (Qw...
New
Exadra37
Oh just spent so much time on this to discover now that RancherOS is in end of life but Rancher is refusing to mark the Github repo as su...
New
PragmaticBookshelf
Create efficient, elegant software tests in pytest, Python's most powerful testing framework. Brian Okken @brianokken Edited by Kat...
New
PragmaticBookshelf
Rails 7 completely redefines what it means to produce fantastic user experiences and provides a way to achieve all the benefits of single...
New
AstonJ
If you want a quick and easy way to block any website on your Mac using Little Snitch simply… File > New Rule: And select Deny, O...
New
AstonJ
This is a very quick guide, you just need to: Download LM Studio: https://lmstudio.ai/ Click on search Type DeepSeek, then select the o...
New
PragmaticBookshelf
As digital systems increasingly run the world, mastery of the recurring patterns of software development risk is the key to fast and effe...
New