63 - NHR PerfLab Seminar 2024-02-27: Performance of linear solvers in tensor-train format on current multicore architectures/ClipID:51607 previous clip next clip

The automatic subtitles generated using Whisper Open AI in this video player (and in the Multistream video player) are provided for convenience and accessibility purposes. However, please note that accuracy and interpretation may vary. For more information, please refer to the FAQs (Paragraph 14).
Recording date 2024-03-27





Organisational Unit

Zentrum für Nationales Hochleistungsrechnen Erlangen (NHR@FAU)


Zentrum für Nationales Hochleistungsrechnen Erlangen (NHR@FAU)

Speaker: Melven Röhrig-Zöllner, German Aerospace Center (DLR)

Title: Performance of linear solvers in tensor-train format on current multicore architectures

Date and time: Tuesday, February 27, 2024, 2:00-3:00 p.m. CET

Slides: https://hpc.fau.de/files/2024/03/NHR_PerfLab_2024-02-27_Performance-of-linear-solvers-in-TT-format.pdf


This talk discusses the node-level performance of numerical algorithms for handling high-dimensional problems in a compressed tensor format.

It focusses on two problems in particular: (1) approximating large (dense) data (lossy compression) and (2) solving linear systems, both in the tensor-train / matrix-product states format. For both problems, we optimize the required underlying linear algebra operations, respectively the mapping of the high-level algorithm to (potentially less accurate) lower-level operations. In particular, we suggest improvements for costly orthogonalization and truncation steps based on a high-performance implementation of a “Q-less” tall-skinny QR decomposition. Further optimizations for solving linear systems include memory layout optimizations for faster tensor contractions and a simple generic preconditioner. We show performance results on today’s multi-core CPUs where we obtain a speedup of up ~50x over the reference implementation for the lossy compression, and up to ~5x for solving linear systems.

Short Bio:

Melven Röhrig-Zöllner studied Computational Engineering Science at the RWTH Aachen. Since 2014, he works as a researcher in the HPC department of the Institute for Software Technology of the German Aerospace Center (DLR). His research focuses on the performance of numerical methods, in particular in the field of numerical linear algebra. He also supports scientific software development for HPC systems in the DLR, e.g., concerning software engineering practices and testing parallel codes.

More clips in this category "Friedrich-Alexander-Universität Erlangen-Nürnberg Zentralbereich"