78 - HPC Café on January 14, 2025: The Power of Workflow Systems on HPC Clusters - An Introduction to Snakemake/ClipID:55987 previous clip

The automatic subtitles generated using Whisper Open AI in this video player (and in the Multistream video player) are provided for convenience and accessibility purposes. However, please note that accuracy and interpretation may vary. For more information, please refer to the FAQs (Paragraph 14).
Recording date 2025-01-17

Via

Free

Language

English

Organisational Unit

Zentrum für Nationales Hochleistungsrechnen Erlangen (NHR@FAU)

Producer

Zentrum für Nationales Hochleistungsrechnen Erlangen (NHR@FAU)

Speaker: Dr. Christian Meesters, Johannes Gutenberg University Mainz

Date: January 14, 2025

Slides

Abstract:

This talk highlights the benefits of using workflow management systems, with a focus on Snakemake, for multistep data analysis on high-performance computing (HPC) clusters. It shows how workflows can streamline research by automating tasks, managing software environments (e.g., Conda, containers, module files), and handling HPC-specific requirements like resource allocation and job submission. We introduce the Snakemake workflow catalog, a resource for prebuilt workflows to save time and avoid reinventing the wheel. Parameterization enables workflow flexibility and scalability. Finally, the talk will explore how Snakemake facilitates reproducibility, from deployment to comprehensive workflow reports with execution statistics and publication-ready outputs. Material from past events is available at: https://hpc.fau.de/teaching/hpc-cafe/

More clips in this category "Friedrich-Alexander-Universität Erlangen-Nürnberg Zentralbereich"

2025-01-24
IdM-login
protected  
2025-01-23
IdM-login
protected  
2025-01-27
IdM-login / Studon
protected  
2025-01-23
IdM-login
protected  
2025-01-23
IdM-login / Studon
protected  
2025-01-21
IdM-login
protected