Tag: GPU

Optimization Techniques in Scientific Computing (Part III) Optimization Techniques in Scientific Computing (Part III) Introduction and recap Run code on a GPU First attempt Further vectorization Batch matrix multiplication Final boost Conclusion Introduction and recap In my previous two blogs for optimization techniques in scientific computing, I have talked about concepts such as vectorization and…

Optimization Techniques in Scientific Computing (Part II) Optimization Techniques in Scientific Computing (Part II) Introduction and recap The first implementation Optimization ideas Parallelism Core-level Node-level Cluster-level Key consideration Introduction and recap In my previous blog, I introduced some straightforward yet valuable optimization techniques. While these techniques are generally suitable for relatively simple problems, such as…

Optimization Techniques in Scientific Computing (Part I) Optimization Techniques in Scientific Computing (Part I) Introduction Description of the problem A naive implementation Optimization ideas Follow memory layout Reduce memory allocation Vectorization Introduction Scientific research is inherently linked to the collection and analysis of data. In today’s world, the volume of data involved in most scientific…