ManningBooks

ManningBooks

Devtalk Sponsor

Grokking Parallel Programming (Manning)

Parallel programming has become essential to everything from AI and scientific computing to image processing, but learning it can still feel like being dropped into the deep end of threads, memory, and unfamiliar GPU terminology.

SungHwan Yun

Grokking Parallel Programming: With Examples in CUDA by SungHwan Yun takes a much friendlier route. It starts with a question that matters: how do you stop thinking sequentially and learn to recognize work that can happen at the same time?

The book uses visual explanations, approachable analogies, and small CUDA programs to build that way of thinking from the ground up. You’ll learn how to:

• Write and launch your first CUDA kernels
• Organize work across threads, blocks, and grids
• Move data safely between the CPU and GPU
• Recognize reusable patterns such as Map and Reduction
• Avoid race conditions and out-of-bounds memory access
• Understand when parallelization will help—and when it won’t

One detail I particularly like is that you don’t need to own an NVIDIA GPU to begin. The exercises run in a free browser-based lab, so anyone comfortable with basic C functions and loops can start experimenting with actual CUDA code.

Five chapters are currently available through Manning’s Early Access Program. Because it’s a MEAP, readers can follow the book as it develops, receive new chapters as they’re released, and send feedback that can help shape the finished edition.

If you’ve been curious about what happens underneath frameworks such as PyTorch and TensorFlow—or you simply want to develop a better instinct for designing parallel algorithms—this is a practical place to start.


Don’t forget you can get 45% off with your Devtalk discount! Just use the coupon code “devtalk.com” at checkout :+1:

Where Next?

Popular Frontend topics Top

PragmaticBookshelf
Dive right into React by defining components, the basic building blocks of a React application. Ludovico Fischer @ludofischer Edite...
New
PragmaticBookshelf
Design websites faster than ever using Sass—the most mature and popular CSS meta-language. Code the right way in Sass with short, clear e...
New
PragmaticBookshelf
Web development is constantly changing, and you need to stay on top of your game. Discover a wide spectrum of web development techniques ...
New
PragmaticStudio
Let’s get real. As in really knowing—clearly and practically—what’s up with Phoenix LiveView. What is it? How does it work? What can I ...
New
AstonJ
They now have a beginners course on NodeJS, following their beginners course on Javascript. I’m hoping they will do one o...
New
ManningBooks
Systems Programming with Zig shows you how to write quality, useful Zig applications without relying on libraries or frameworks-even if y...
New
ManningBooks
For over fifteen years, The Well-Grounded Rubyist has taught beginner and developing Ruby programmers the veteran secrets of Ruby. This n...
New
ManningBooks
In Fabulous Adventures in Data Structures and Algorithms, language designer and C# legend Eric Lippert explores exciting, esoteric, and e...
New
ManningBooks
Written by core Node.js and TC-39 committee contributor James M. Snell, JavaScript in Depth teaches you what’s really happening when Java...
New
ManningBooks
Server-Side WebAssembly lays out everything you need to take WebAssembly beyond its traditional browser domain. You’ll put on the hats of...
New

Other popular topics Top

PragmaticBookshelf
Instantly view the changes you make to an app with stateful hot reload, and define a declarative UI in the same language as the app logic...
New
AstonJ
There’s a whole world of custom keycaps out there that I didn’t know existed! Check out all of our Keycaps threads here: https://forum....
New
PragmaticBookshelf
Rust is an exciting new programming language combining the power of C with memory safety, fearless concurrency, and productivity boosters...
New
dimitarvp
Small essay with thoughts on macOS vs. Linux: I know @Exadra37 is just waiting around the corner to scream at me “I TOLD YOU SO!!!” but I...
New
AstonJ
Continuing the discussion from Thinking about learning Crystal, let’s discuss - I was wondering which languages don’t GC - maybe we can c...
New
AstonJ
If you get Can't find emacs in your PATH when trying to install Doom Emacs on your Mac you… just… need to install Emacs first! :lol: bre...
New
PragmaticBookshelf
Develop, deploy, and debug BEAM applications using BEAMOps: a new paradigm that focuses on scalability, fault tolerance, and owning each ...
New
CommunityNews
A Brief Review of the Minisforum V3 AMD Tablet. Update: I have created an awesome-minisforum-v3 GitHub repository to list information fo...
New
PragmaticBookshelf
Get the comprehensive, insider information you need for Rails 8 with the new edition of this award-winning classic. Sam Ruby @rubys ...
New
pragdave
Build robust LLM-powered apps, chatbots, and agents while mastering AI engineering principles that will help you outlast the tools and th...
New