Under construction
This tutorial is still under construction. Materials and instructions may change before eScience 2026.
Portable by Design
Deploying Notebook-based Scientific Workflows Across HPC Clusters
Scientific workflows can be difficult to reproduce and move between high-performance computing (HPC) systems. Software stacks differ, data may live in site-specific locations, and each cluster exposes its own resources and execution environment.
This hands-on tutorial introduces three complementary open-source tools—TaskVine, Sciunit, and Floability—for addressing these challenges. You will build a distributed workflow with TaskVine, capture a reproducible execution with Sciunit, and deploy a portable notebook-based workflow as a Floability backpack.
Short presentations introduce each concept, followed immediately by guided exercises that put it into practice.
Tutorial at a glance
- Format: short presentations and guided hands-on exercises
- Duration: 3 hours total, including a 15-minute break
- Tools: TaskVine, Sciunit, and Floability
- Setup: prepared tutorial server or a self-managed x86-64 Linux system
Tutorial outline
Part I — TaskVine and Sciunit · 90 minutes
| Time | Topic | Materials |
|---|---|---|
| 10 min | Tutorial overview — tutorial goals, the portability problem, the three-tool ecosystem, and the TaskVine manager-worker model | Slides |
| 15 min | Access, setup, and TaskVine quickstart | Setup · Hands-on |
| 35 min | TaskVine application structure and execution — tasks, files, workers, and result collection | Slides · Documentation · Hands-on |
| 30 min | Reproducible execution with Sciunit — capture, inspect, and reproduce an execution | Slides (coming soon) · Hands-on |
Break · 15 minutes
Part II — Floability · 75 minutes
| Time | Topic | Materials |
|---|---|---|
| 10 min | Floability overview — portable workflow deployment and the backpack model | Slides · Overview |
| 15 min | Run your first backpack — deploy and interact with an existing notebook workflow | Hands-on |
| 10 min | Structure of a backpack — workflow, software, data, and compute specifications | Slides · Guide |
| 20 min | Create and run a backpack — package a workflow and complete its specifications | Hands-on |
| 15 min | Generate a backpack automatically — use Audit to produce initial specifications from a working notebook environment | Hands-on |
| 5 min | Wrap-up and questions | Key takeaways and next steps |
How the tools fit together
TaskVine provides the distributed execution layer. A manager creates tasks, workers obtain those tasks dynamically, and TaskVine moves required files and returns results.
Sciunit captures an execution and its dependencies so that it can be inspected and reproduced outside the original environment.
Floability packages a workflow with its software, data, and compute specifications in a portable deployment unit called a backpack. It prepares the execution environment and connects the workflow to computing resources through TaskVine.
What you will learn
By the end of the tutorial, you will be able to:
- build and execute a distributed workflow with TaskVine;
- explain TaskVine's manager-worker execution model;
- capture and reproduce a workflow execution with Sciunit;
- run a notebook workflow packaged as a Floability backpack;
- identify the workflow, software, data, and compute specifications in a backpack;
- create and run a backpack from an existing workflow; and
- use Floability Audit to generate initial backpack specifications for manual review.
Related resources
Ready to begin?
Start by connecting to the prepared tutorial environment or setting up the exercises on your own Linux system.