Skip to main content

Programming Game Development Computer Science Data Science Machine Learning GPU & Accelerators Embedded Systems

Overview
Overview
Parallel Computing Foundations
GPU Hardware Architecture
CUDA Programming Model
CUDA Memory Model
Execution and Synchronization
CUDA Runtime and APIs
Kernel Optimization
Libraries and Ecosystem
Tooling, Profiling, and Debugging
Multi-GPU and Scaling
Portable and Vendor-Neutral
NPUs and Inference Accelerators
Applied Kernels and Patterns

Applied Kernels and Patterns
Softmax & LayerNorm

Softmax and LayerNorm Kernels

This page has not been written yet.

Tags:

gpu
cuda
kernels
softmax

Last updated on Aug 13, 2026

Sparse Matrix-Vector

Docs

Programming
Game Development
Computer Science
Data Science
Machine Learning
GPU & Accelerators

More

Blog
GitHub

Copyright © 2026 Andrii Sonsiadlo. Knowledge Base.