ESCAPE WP3+WP5 coordination meeting I [ID:24524]
50 von 386 angezeigt

Okay, now you're also informed.

So, as I said, the meeting agenda is quite obvious.

So what we're here for is basically, first of all, find out what are actually the topics that are overlapping between Work Package 3 and Work Package 5.

So identify basically the issues.

Then perhaps figure out who is actually concerned with these issues, so subgroups, etc.

And then, of course, how can we progress to solve these issues? So it's kind of the typical questions.

And so to actually get together on the same page, more or less, I have asked Sheng to give a short introduction into the Work Package 5 activities,

so that Work Package 3 people can get a better overview of what's happening there and vice versa. I try to give a short intro to perhaps relevant aspects of WP3 for the WP5 people.

And then, so there is a time slot for, let's say, smaller issues. So there have been certain questions or aspects with very concrete,

very concrete targets put forward that are given a small space then to present these projects or these sub-projects basically,

that are also touching into these two Work Packages. And then there's the space for discussion. But we hopefully solve it all, well, basically, or at least get the first step done towards the cooperation.

So, and without further ado, I would say, Sheng, do you want to start?

Yes, sure. Let me share my screen.

Is this the one? Let's try.

So you see my slides? Yes.

Okay, that's good.

Yeah, welcome everyone and great that you organized this, taking the initiative to do this. And it's great to see that lots of people are participating.

And within Work Package 5, we're indeed also from our last progress meeting,

so there are also lots of discussions regarding how we will, when it's to integrate with the software repository. So here I would just to give a general overview of what Work Package 5 does and what are the related activities to Work Package 3.

And so what we are currently working on in this aspect, and then start some discussion, I mean, mentioned some topics that we can discuss later on during the discussion session.

So, probably all of you have already seen this many, many times that we are building Work Package 5 is responsible for building S3 science analysis platform.

And from this platform, allow users to find and process their data from the different facilities and archives. And also, so basically to process these or to analyze the data that has been found from the platform.

We actually so needs to find the software related to this data and make them available through the compute platform. So the compute facilities can be either, let's say interactive analysis or batch processing so HPC or HTC infrastructures.

So, there were four tasks, well actually five, including management discuss, they describe in WorkPage 5. And actually three of them are related to software.

So these are actually so except the first one for data aggregation and staging, all the others are related to WorkPage 3. So the task 5.2 for example is for software deployment and virtualization.

And the many partners, we know that within escape. So basically all the S phrase, not only within WorkPage 5 but across escape are actually working on making them their software.

So continue to rise to virtualized and be able to easily deploy them.

So, here mentioned in the, in the WorkPage 5 task is to provide access to software repository metadata. And I think from our point of view is to get this metadata to matchmaking with the data that has been found with waste.

From the, for the user. But I think this metadata will come actually from the software repository, which probably this is another discussion point for later.

And the idea we want to do is indeed the support containerization of the tools. So when, when the software is containerized from partners, and we will need to find a way, let's say to make them available on the compute platform.

And for the other task 5.3 for the analysis interface and workflows reproducibility is actually really related to, I think this also closely related to the, to WorkPage 3.

And the last task for integration ways HPC and HTC infrastructures. So, when we find the data, we need to make, let's say the user workflows available through on these on these machines.

So, so I think it's really great that we have this call because you can see that from now on after we wave from work types five we deliver the first

The milestone for for demonstrating data aggregation and staging. The next big step for us is actually to integrate it with software and that covers a lot of tasks from work page five.

And as you may know that within work page five we have the interactive data analysis working group, led by University of Edinburgh, Estelios, and from this, this working group

we used this this flow of how user may get, let's say when the user gets onto the gateway, get onto ESAP, how it's going to find these services.

So, through the ESAP API gateway there will be, let's say the discovery service for finding facilities, so it can be Jupyter facilities or HPC computing facilities.

And then of course there will be the workflow finder, so which is basically the software of the metadata of the software to do a matchmaking and make them available through, let's say interfaces, through let's say Jupyter hub APIs or HPC HTC interfaces to send these.

And from also there is a user profile model within within ESAP, where the user also has basically a data shopping cart.

Let's say not not only for data, if you look at the user cart is actually includes the data that's select is selected by the user and the compute facilities has access to or wants to use.

Or it has access to, which, which means this workflow is actually the metadata will be, let's say, connected to the work package three data workflow or software repository.

And then that will be fired all together, send all this information will be sent together, let's say to start the compute session.

And that's basically what I would like to present regarding the relationship between work pages three and five, and here are some discussion points.

I think we can see, look at them again.

When we start the discussion.

So, I will stop here. Thank you.

Thanks, Cheng.

Are there any immediate questions on the presentation.

Probably I should look at the participants list. So, if there are no raised hands. I think everybody knows this feature by now.

I will shortly add the WP3 site to that.

Zugänglich über

Offener Zugang

Dauer

01:13:13 Min

Aufnahmedatum

2020-11-20

Hochgeladen am

2020-11-20 23:59:26

Sprache

en-US

Recording of the first coordination meeting between ESCAPE Workpackage 5 (ESAP) and Workpackage 3 (OSSR).

Einbetten
Wordpress FAU Plugin
iFrame
Teilen