ManningBooks

ManningBooks

Devtalk Sponsor

Grokking Parallel Programming (Manning)

Parallel programming has become essential to everything from AI and scientific computing to image processing, but learning it can still feel like being dropped into the deep end of threads, memory, and unfamiliar GPU terminology.

SungHwan Yun

Grokking Parallel Programming: With Examples in CUDA by SungHwan Yun takes a much friendlier route. It starts with a question that matters: how do you stop thinking sequentially and learn to recognize work that can happen at the same time?

The book uses visual explanations, approachable analogies, and small CUDA programs to build that way of thinking from the ground up. You’ll learn how to:

• Write and launch your first CUDA kernels
• Organize work across threads, blocks, and grids
• Move data safely between the CPU and GPU
• Recognize reusable patterns such as Map and Reduction
• Avoid race conditions and out-of-bounds memory access
• Understand when parallelization will help—and when it won’t

One detail I particularly like is that you don’t need to own an NVIDIA GPU to begin. The exercises run in a free browser-based lab, so anyone comfortable with basic C functions and loops can start experimenting with actual CUDA code.

Five chapters are currently available through Manning’s Early Access Program. Because it’s a MEAP, readers can follow the book as it develops, receive new chapters as they’re released, and send feedback that can help shape the finished edition.

If you’ve been curious about what happens underneath frameworks such as PyTorch and TensorFlow—or you simply want to develop a better instinct for designing parallel algorithms—this is a practical place to start.


Don’t forget you can get 45% off with your Devtalk discount! Just use the coupon code “devtalk.com” at checkout :+1:

Most Liked

alvinkatojr

alvinkatojr

Ok, this one looks FIRE! :fire: :fire: :fire:

And I don’t even need an NVIDIA GPU?! :exploding_head:

Way to go Manning!

jss

jss

Yup, book looks interesting, but I haven’t done C programming for more than a decade.

Where Next?

Popular Frontend topics Top

PragmaticBookshelf
Database-driven sites bring complexity you might not need, but building a site by hand is too much work. Hugo is a static site generator ...
New
PragmaticBookshelf
Dive right into React by defining components, the basic building blocks of a React application. Ludovico Fischer @ludofischer Edite...
New
PragmaticBookshelf
Web development is constantly changing, and you need to stay on top of your game. Discover a wide spectrum of web development techniques ...
New
AstonJ
If you know of any good learning resources for Svelte please post them here :smiley: Here’s some to get us started: The official tutori...
New
PragmaticBookshelf
Tailwind CSS is an exciting new CSS framework that allows you to design your site by composing simple utility classes to create complex e...
New
ManningBooks
Tired of wrestling with HTML, CSS, or JavaScript just to get a simple web UI up and running? With Streamlit, you can create powerful, in...
New
ManningBooks
Latency: Reduce delay in software systems shows you how to troubleshoot latency in existing applications and create low-latency systems f...
New
ManningBooks
Written by core Node.js and TC-39 committee contributor James M. Snell, JavaScript in Depth teaches you what’s really happening when Java...
New
pragdave
New code becomes cheaper every day, but maintenance does not. Bugs are faster, subtler, and harder to catch, and dealing with them is inc...
New
ManningBooks
Spring Start Here, Second Edition by Laurenţiu Spilcă is a foundations-first introduction to the Spring framework. Perfect for Spring beg...
New

Other popular topics Top

New
PragmaticBookshelf
Ruby, Io, Prolog, Scala, Erlang, Clojure, Haskell. With Seven Languages in Seven Weeks, by Bruce A. Tate, you’ll go beyond the syntax—and...
New
Rainer
My first contact with Erlang was about 2 years ago when I used RabbitMQ, which is written in Erlang, for my job. This made me curious and...
New
AstonJ
Do the test and post your score :nerd_face: :keyboard: If possible, please add info such as the keyboard you’re using, the layout (Qw...
New
PragmaticBookshelf
Author Spotlight Mike Riley @mriley This month, we turn the spotlight on Mike Riley, author of Portable Python Projects. Mike’s book ...
New
AnfaengerAlex
Hello, I’m a beginner in Android development and I’m facing an issue with my project setup. In my build.gradle.kts file, I have the foll...
New
AstonJ
This is a very quick guide, you just need to: Download LM Studio: https://lmstudio.ai/ Click on search Type DeepSeek, then select the o...
New
NewsBot
Node.js v22.14.0 has been released. Link: Release 2025-02-11, Version 22.14.0 'Jod' (LTS), @aduh95 · nodejs/node · GitHub
New
PragmaticBookshelf
Lint your docs like code: turn any style guide into enforceable rules with Vale and publish clear, consistent content every time. ...
New
PragmaticBookshelf
Write elegant Ruby code—not just correct, but idiomatic. Go beyond the vocabulary and syntax and learn to express yourself with eloquence...
New