ManningBooks

ManningBooks

Devtalk Sponsor

Grokking Parallel Programming (Manning)

Parallel programming has become essential to everything from AI and scientific computing to image processing, but learning it can still feel like being dropped into the deep end of threads, memory, and unfamiliar GPU terminology.

SungHwan Yun

Grokking Parallel Programming: With Examples in CUDA by SungHwan Yun takes a much friendlier route. It starts with a question that matters: how do you stop thinking sequentially and learn to recognize work that can happen at the same time?

The book uses visual explanations, approachable analogies, and small CUDA programs to build that way of thinking from the ground up. You’ll learn how to:

• Write and launch your first CUDA kernels
• Organize work across threads, blocks, and grids
• Move data safely between the CPU and GPU
• Recognize reusable patterns such as Map and Reduction
• Avoid race conditions and out-of-bounds memory access
• Understand when parallelization will help—and when it won’t

One detail I particularly like is that you don’t need to own an NVIDIA GPU to begin. The exercises run in a free browser-based lab, so anyone comfortable with basic C functions and loops can start experimenting with actual CUDA code.

Five chapters are currently available through Manning’s Early Access Program. Because it’s a MEAP, readers can follow the book as it develops, receive new chapters as they’re released, and send feedback that can help shape the finished edition.

If you’ve been curious about what happens underneath frameworks such as PyTorch and TensorFlow—or you simply want to develop a better instinct for designing parallel algorithms—this is a practical place to start.


Don’t forget you can get 45% off with your Devtalk discount! Just use the coupon code “devtalk.com” at checkout :+1:

Most Liked

alvinkatojr

alvinkatojr

Ok, this one looks FIRE! :fire: :fire: :fire:

And I don’t even need an NVIDIA GPU?! :exploding_head:

Way to go Manning!

jss

jss

Yup, book looks interesting, but I haven’t done C programming for more than a decade.

Where Next?

Popular Frontend topics Top

PragmaticBookshelf
You work in a loop: write code, get feedback, iterate. The faster you get feedback, the faster you can learn and become a more effective ...
New
PragmaticBookshelf
Upgrade your skill set, succeed at work, and avoid the many headaches that come with modern front-end development. Simplify your codebase...
New
PragmaticBookshelf
Design and code JavaScript applications with automated tests. Fire up your editor and get hands-on through practical exercises for effect...
New
First poster: AstonJ
Welcome to Learn CSS! This course breaks down the fundamentals of CSS into digestible, easy to understand pieces. Over the next few modul...
New
ManningBooks
In Learn Docker in a Month of Lunches, Docker expert Elton Stoneman guides through everything you need to know about Docker in 22 short l...
New
ManningBooks
For over fifteen years, The Well-Grounded Rubyist has taught beginner and developing Ruby programmers the veteran secrets of Ruby. This n...
New
pragdave
New code becomes cheaper every day, but maintenance does not. Bugs are faster, subtler, and harder to catch, and dealing with them is inc...
New
New
ManningBooks
In Web Component Development with Modern Libraries and Tooling, you’ll learn how to build reusable web components that last well beyond t...
New
ManningBooks
It’s frustrating to deliver a feature exactly as specified and still wonder whether it solves a problem anyone actually has. Raising that...
New

Other popular topics Top

PragmaticBookshelf
Write Elixir tests that you can be proud of. Dive into Elixir’s test philosophy and gain mastery over the terminology and concepts that u...
New
brentjanderson
Bought the Moonlander mechanical keyboard. Cherry Brown MX switches. Arms and wrists have been hurting enough that it’s time I did someth...
New
AstonJ
In case anyone else is wondering why Ruby 3 doesn’t show when you do asdf list-all ruby :man_facepalming: do this first: asdf plugin-upd...
New
Margaret
Hello everyone! This thread is to tell you about what authors from The Pragmatic Bookshelf are writing on Medium.
1147 29994 760
New
AstonJ
We’ve talked about his book briefly here but it is quickly becoming obsolete - so he’s decided to create a series of 7 podcasts, the firs...
New
New
PragmaticBookshelf
Develop, deploy, and debug BEAM applications using BEAMOps: a new paradigm that focuses on scalability, fault tolerance, and owning each ...
New
CommunityNews
A Brief Review of the Minisforum V3 AMD Tablet. Update: I have created an awesome-minisforum-v3 GitHub repository to list information fo...
New
AstonJ
If you’re getting errors like this: psql: error: connection to server on socket “/tmp/.s.PGSQL.5432” failed: No such file or directory ...
New
PragmaticBookshelf
Quickly turn complex problems into simple, working solutions using functional programming, safe concurrency, and the expressive tools of ...
New