Name: LTA Development Workshop
Start: 2024-09-18T12:00:00+02:00
End: 2024-09-20T16:00:00+02:00
Location: ASTRON

LTA Development Workshop

from Wednesday, 18 September 2024 (12:00) to Friday, 20 September 2024 (16:00)

Monday, 16 September 2024
Tuesday, 17 September 2024
Wednesday, 18 September 2024

12:00 Lunch (provided)
Lunch (provided)
12:00 - 13:00
13:00 Welcome & Logistics - John Swinbank (ASTRON)
Welcome & Logistics
- John Swinbank (ASTRON)
13:00 - 13:15
13:15 LOFAR ERIC: Now & Next - Michiel van Haarlem (ASTRON)
LOFAR ERIC: Now & Next
- Michiel van Haarlem (ASTRON)
13:15 - 13:45
An overview of the current status of LOFAR ERIC. What is the plan for LOFAR2.0, and what happens after that?
13:45 LOFAR Data Services: now and next - Roberto Pizzo
LOFAR Data Services: now and next
- Roberto Pizzo
13:45 - 14:15
- Current status & successes - Future ambition - Data policies - Resource challenges
14:15 A Vision for Future LOFAR Data Services - John Swinbank (ASTRON)
A Vision for Future LOFAR Data Services
- John Swinbank (ASTRON)
14:15 - 14:30
14:30 Technical Overview of the LTA - Hanno Holties
Technical Overview of the LTA
- Hanno Holties
14:30 - 15:00
15:00 Break
Break
15:00 - 15:30
15:30 Lessons Learned - Emanuela Orru (Astron)
Lessons Learned
- Emanuela Orru (Astron)
15:30 - 16:15
16:15 Brainstorm: What are the biggest challenges? - John Swinbank (ASTRON)
Brainstorm: What are the biggest challenges?
- John Swinbank (ASTRON)
16:15 - 17:00
Given everything that we've heard today, what are the major challenges that face the LTA in the future? We'll use these to help seed the agenda over the next couple of days. Miro Board: https://edu.nl/h6g3f
Thursday, 19 September 2024
09:00 Site Update: PSNC - Maciej Brzezniak (PSNC)
Site Update: PSNC
- Maciej Brzezniak (PSNC)
09:00 - 09:30
09:30 Site Update: FZJ - Cristina Manzano (FZJ)
Site Update: FZJ
- Cristina Manzano (FZJ)
09:30 - 10:00
10:00 Site Update: SURF - Lodewijk Nauta (SURF)
Site Update: SURF
- Lodewijk Nauta (SURF)
10:00 - 10:30
10:30 Break
Break
10:30 - 11:00
11:00 The SKA Regional Centre Network - Raymond Oonk (SURF)
The SKA Regional Centre Network
- Raymond Oonk (SURF)
11:00 - 11:30
11:30 The Vera C. Rubin Observatory - Fabio Hernandez (CNRS-IN2P3 Computing Centre / Vera C. Rubin Observatory)
The Vera C. Rubin Observatory
- Fabio Hernandez (CNRS-IN2P3 Computing Centre / Vera C. Rubin Observatory)
11:30 - 12:00
12:00 Discussion: Learning together; Federation, EOSC, and Open Science
Discussion: Learning together; Federation, EOSC, and Open Science
12:00 - 12:30
1. Are there things we heard that we should be collaborating / learning together on? 2. All of the sites have been showing their own fantastic infrastructure. How do we give LOFAR users a uniform experience while also taking advantage of those capabilities? 3. Should we see LTA sites as “storage” or “data management”? 4. We've already heard that the LTA is moving towards a federated AAI system, and the LOFAR ERIC Data Policy (https://www.lofar.eu/lofar2-0-documentation/) affirms a commitment “to adhere to the principles of Open Science, Open Access, and FAIR data”. What else is needed? Can we leverage the EOSC EU Node? Other EOSC services?

12:30 Lunch (provided)
Lunch (provided)
12:30 - 13:30
13:30 Token authentication in dCache - Onno Zweers
Token authentication in dCache
- Onno Zweers
13:30 - 14:00
dCache supports authentication with Macaroon tokens and with OIDC tokens. I'd like to explain what they are, how they differ, how to use them, how to configure them in dCache, and how to troubleshoot them.
14:00 Towards more structured long-term data archiving - Holger Stiele
Towards more structured long-term data archiving
- Holger Stiele
14:00 - 14:20
At the moment, the long-term archive sites do not have knowledge about the (scientific) content of the observations that are stored. If we know, e.g. which observations belong from an observational and astrophysical point of view together, it may be possible to archive these data on the same tape, minimising the costs in time and energy to retrieve them. As with the upgrade to LOFAR 2.0 it is also foreseen to save advanced data products it will be necessary to store the data in a comprehensible way so that it is clear which data sets of different levels belong together. Based on this information, we would like to build a knowledge tree that in the end would e.g. allow to suggest to observers other archived observation that cover similar objects. Such a structure will also help to provide data according to the FAIR principles and facilitate reuse in the age of multi-wavelength astronomy.
14:20 LOFAR science pipelines: technologies and future plans - Marcel Loose
LOFAR science pipelines: technologies and future plans
- Marcel Loose
14:20 - 14:35
14:35 ASTRON's ATDB-based pipeline execution system - Hanno Holties
ASTRON's ATDB-based pipeline execution system
- Hanno Holties
14:35 - 14:50
14:50 Break
Break
14:50 - 15:20
15:20 The Stimela Workflow Management Framework - Oleg Smirnov
The Stimela Workflow Management Framework
- Oleg Smirnov
15:20 - 15:40
15:40 Discussion: distributed processing within the LTA
Discussion: distributed processing within the LTA
15:40 - 16:25
- What technical options are there — frameworks or other services that the data centres support or suggest and that we can build on? - What should the interaction between ASTRON and the LTA sites look like as we roll out process in Jülich & Poznan? Are there skills, people, expertise at the sites we can look to for help? - What sort of coupling is needed across LTA sites — do we need to e.g. transfer data stored at one site to process at another?

16:25 Discussion: Communication Needs
Discussion: Communication Needs
16:25 - 16:55
We heard yesterday that LTA sites would like: - More / earlier involvement in design decisions and future plans - More information on staging requests - More insight into how data is going to be used What communications and data management plans do we need to put in place to ensure these needs are appropriately met?

18:00 Group Dinner
Group Dinner
18:00 - 20:00
Onder de Eiken, Dwingeloo https://onderdeeiken.nl
Friday, 20 September 2024
09:00 Future Science with the LOFAR Observatory - Andre Offringa (ASTRON)
Future Science with the LOFAR Observatory
- Andre Offringa (ASTRON)
09:00 - 09:30
09:30 Data discovery and (interactive) analysis work in SRCNet and at ASTRON - Yan Grange (ASTRON)
Data discovery and (interactive) analysis work in SRCNet and at ASTRON
- Yan Grange (ASTRON)
09:30 - 10:00
- Science Platform Vision Document - Science Gateway - Canfar, Azimuth, etc. - ADEX, ESAP, etc
10:00 Discussion: A science platform for the LTA?
Discussion: A science platform for the LTA?
10:00 - 10:30

10:30 Break
Break
10:30 - 11:00

11:00 Discussion: Conclusions and Next Steps
Discussion: Conclusions and Next Steps
11:00 - 12:30
To consider: - Brainstorm: what technologies do the LTA sites have access to that we should be exploiting? What are the topics of common interest that we can work together on in the future? - A roadmap for LTA evolution - Was this meeting useful? Should we have more like it? A different format? - Topics arising from discussions throughout the meeting

12:30 Lunch (provided)
Lunch (provided)
12:30 - 13:30