Lustre User Group 2023: Difference between revisions

From Lustre Wiki
Jump to navigation Jump to search
(initial copy from https://na.eventscloud.com/website/48957/agenda/)
 
(→‎LUG 2022 Agenda: add video links)
(3 intermediate revisions by the same user not shown)
Line 15: Line 15:
|-
|-
|''' 09:30-10:00'''
|''' 09:30-10:00'''
|'''[[Media:LUG2023-SDSC_Lustre_Experiences-Tatineni.pdf|Experiences and Approaches for Supporting Lustre for a Large User Environment]]'''
|'''[[Media:LUG2023-SDSC_Lustre_Experiences-Tatineni.pdf|Experiences and Approaches for Supporting Lustre for a Large User Environment]]''' ([https://m.youtube.com/watch?v=R6ofC9LzfZs video])
:  Mahidhar Tatineni, SDSC
:  Mahidhar Tatineni, SDSC


|-
|-
|''' 10:00-10:30'''
|''' 10:00-10:30'''
|'''[[Media:LUG2023-Community_Release_Update-Jones.pdf|Community Release Update]]'''
|'''[[Media:LUG2023-Community_Release_Update-Jones.pdf|Community Release Update]]''' ([https://m.youtube.com/watch?v=WnlXZwVw2bA video])
:  Peter Jones, Whamcloud
:  Peter Jones, Whamcloud


|-
|-
|''' 11:00-11:30'''
|''' 11:00-11:30'''
|'''[[Media:LUG2023-Amazon_Lustre_FSX-Osborne.pdf|Bringing Lustre to the Masses Through a Fully-managed Cloud Service]]'''
|'''[[Media:LUG2023-Amazon_Lustre_FSX-Osborne.pdf|Bringing Lustre to the Masses Through a Fully-managed Cloud Service]]''' ([https://m.youtube.com/watch?v=0fMdtrCXxTM&pp=ygUPI2VpbnNjaHVsdWcyMDIz video])
:  Darryl Osborne, Amazon
:  Darryl Osborne, Amazon


|-
|-
|''' 11:30-12:00'''
|''' 11:30-12:00'''
|'''[[Media:LUG2023-Lustre_Client_Encryption-Buisson.pdf|Lustre Client Encrytion]]'''
|'''[[Media:LUG2023-Lustre_Client_Encryption-Buisson.pdf|Lustre Client Encrytion]]''' ([https://m.youtube.com/watch?v=4cQM-xoeqa0 video])
:  Sebastien Buisson, DDN
:  Sebastien Buisson, DDN


|-
|-
|''' 13:30-14:00'''
|''' 13:30-14:00'''
|'''[[Media:LUG2023-Understanding_Lustre_Timeouts-Mohr.pdf|Understanding Lustre Timeouts]]'''
|'''[[Media:LUG2023-Understanding_Lustre_Timeouts-Mohr.pdf|Understanding Lustre Timeouts]]''' ([https://m.youtube.com/watch?v=MEQem0ZYIGE video])
:  Richard Mohr, ORNL
:  Richard Mohr, ORNL


|-
|-
|''' 14:00-14:30'''
|''' 14:00-14:30'''
|'''[[Media:LUG2023-Client_Side_Data_Compression-Blagodarenko.pdf|Client-side Data Compression]]'''
|'''[[Media:LUG2023-Client_Side_Data_Compression-Blagodarenko.pdf|Client-side Data Compression]]''' ([https://m.youtube.com/watch?v=fCQNL92fyuI video])
:  Colin Faber, Artem Blagodarenko, Whamcloud
:  Colin Faber, Artem Blagodarenko, Whamcloud


|-
|-
|''' 15:00-15:30'''
|''' 15:00-15:30'''
|'''[[Media:LUG2023-Experiences_Stampede2_Frontera_TACC-Thorne.pdf|Experiences with Lustre on Stampede2 and Frontera]]'''
|'''[[Media:LUG2023-Experiences_Stampede2_Frontera_TACC-Thorne.pdf|Experiences with Lustre on Stampede2 and Frontera]]''' ([https://m.youtube.com/watch?v=wkYBLBVOqQ0 video])
:  Nick Thorne, TACC
:  Nick Thorne, TACC
|-
|-
|''' 16:00-16:30'''
|''' 16:00-16:30'''
|'''[[Media:LUG2023-OpenSFS_Update.pdf|OpenSFS Update]]'''
|'''[[Media:LUG2023-OpenSFS_Update.pdf|OpenSFS Update]]''' ([https://www.youtube.com/watch?v=Impua4iUqLY video])
:  OpenSFS Board
:  OpenSFS Board


Line 64: Line 64:
|-
|-
|''' 09:00-09:30'''
|''' 09:00-09:30'''
|'''[[Media:LUG2023-Balanced_Production_Migration-CHarr.pdf|Getting a Balanced, Full Production File System Migration to Work]]'''
|'''[[Media:LUG2023-Balanced_Production_Migration-CHarr.pdf|Getting a Balanced, Full Production File System Migration to Work]]''' ([https://m.youtube.com/watch?v=-PCXNCkoaQA video])
:  Cameron Harr, LLNL
:  Cameron Harr, LLNL


|-
|-
|''' 09:30-10:00'''
|''' 09:30-10:00'''
|'''[[Media:LUG2023-Managing_Cloud_As_Code-Vaughn.pdf|Managing Cloud HPC with Infrastructure-as-Code]]'''
|'''[[Media:LUG2023-Managing_Cloud_As_Code-Vaughn.pdf|Managing Cloud HPC with Infrastructure-as-Code]]''' ([https://m.youtube.com/watch?v=vN_7fT-0jQg video])
:  Matthew Vaughn, Amazon
:  Matthew Vaughn, Amazon


|-
|-
|''' 10:30-11:00'''
|''' 10:30-11:00'''
|'''[[Media:LUG2023-Lustre_2.16_and_Beyond-Dilger.pdf|Lustre 2.16 and Beyond]]'''
|'''[[Media:LUG2023-Lustre_2.16_and_Beyond-Dilger.pdf|Lustre 2.16 and Beyond]]''' ([https://m.youtube.com/watch?v=a1VZ0WMgYIM video])
:  Andreas Dilger, Whamcloud  
:  Andreas Dilger, Whamcloud  


|-
|-
|''' 11:00-11:30'''
|''' 11:00-11:30'''
|'''[[Media:LUG2023-Delivering_Lustre_HPC_Cloud-Sundarraj.pdf|Delivering Lustre 2.15 file system as a HPC cloud service]]'''
|'''[[Media:LUG2023-Delivering_Lustre_HPC_Cloud-Sundarraj.pdf|Delivering Lustre 2.15 Filesystem as an HPC Cloud Service]]''' ([https://m.youtube.com/watch?v=KCFr_d_ddFI&pp=ygUTI2F6dXJlbWFuYWdlZGx1c3RyZQ%3D%3D video])
:  Dilip Sundarraj, Microsoft
:  Dilip Sundarraj, Microsoft


|-
|-
|''' 11:30-12:00'''
|''' 11:30-12:00'''
|'''[[Media:LUG2023-KFILND_and_UDSP-Horn.pdf|Overview of Kfabric Network Driver, and User Defined Selection Policy]]'''
|'''[[Media:LUG2023-KFILND_and_UDSP-Horn.pdf|Overview of Kfabric Network Driver, and User Defined Selection Policy]]''' ([https://m.youtube.com/watch?v=MMA-WcKqp5E&pp=ygUPI2VpbnNjaHVsdWcyMDIz video])
:  Chris Horn, HPE
:  Chris Horn, HPE


|-
|-
|''' 13:00-13:30'''
|''' 13:00-13:30'''
|'''Sponsor Talk: [[Media:LUG2023-Maximizing_AI_Training_Efficiency-Druon.pdf|Maximizing At-Scale AI Training Efficiency]]'''  
|'''Sponsor Talk: [[Media:LUG2023-Maximizing_AI_Training_Efficiency-Druon.pdf|Maximizing At-Scale AI Training Efficiency]]''' ([https://m.youtube.com/watch?v=qBo8-70aBIA video])
:  Raphael Druon, DDN
:  Raphael Druon, DDN


|-
|-
|''' 13:30-14:00'''
|''' 13:30-14:00'''
|'''[[Media:LUG2023-Orion_Configuration_Performance-Mohr.pdf|The Orion File System: Configuration and Performance]]'''
|'''[[Media:LUG2023-Orion_Configuration_Performance-Mohr.pdf|The Orion File System: Configuration and Performance]]''' ([https://m.youtube.com/watch?v=Bj0oJq0sPmo video])
:  Richard Mohr, ORNL
:  Richard Mohr, ORNL


|-
|-
|''' 14:30-15:00'''
|''' 14:30-15:00'''
|'''[[Media:LUG2023-Unaligned_DIO_v2-Farrell.pdf|Unaligned direct I/O]]'''
|'''[[Media:LUG2023-Unaligned_DIO_v2-Farrell.pdf|Unaligned Direct I/O]]''' ([https://m.youtube.com/watch?v=UvcQ0h6FS6M video])
:  Patrick Farrell, Whamcloud
:  Patrick Farrell, Whamcloud


|-
|-
|''' 15:00-15:30'''
|''' 15:00-15:30'''
|'''[[Media:LUG2023-Secure_Namespace_Isolation-Ihara.pdf|Secure namespace isolation in the Lustre]]'''  
|'''[[Media:LUG2023-Secure_Namespace_Isolation-Ihara.pdf|Secure Namespace Isolation in Lustre]]''' ([https://m.youtube.com/watch?v=-JEKQHzbHQM video])
:  Shuichi Ihara, Sebastien Buisson, DDN
:  Shuichi Ihara, Sebastien Buisson, DDN


|-
|-
|''' 16:00-16:30'''
|''' 16:00-16:30'''
|'''[[Media:LUG2023-PoliMOR_Policy_Engine-Brumgard.pdf|The PoliMOR Policy Engine: Improvements and Performance Results]]'''
|'''[[Media:LUG2023-PoliMOR_Policy_Engine-Brumgard.pdf|The PoliMOR Policy Engine: Improvements and Performance Results]]''' ([https://m.youtube.com/watch?v=-WGiRWl6qjQ video])
:  Christopher Brumgard, ORNL
:  Christopher Brumgard, ORNL


|-
|-
|''' 16:30-17:00'''
|''' 16:30-17:00'''
|'''Invited Talk: [[Media:LUG2023-KFILND_and_UDSP-Horn.pdf|Prototype National Research Platform]]'''
|'''Invited Talk: [[Media:LUG2023-Prototype_National_Research_Platform-Wuerthwein.pdf|Prototype National Research Platform]]''' ([https://m.youtube.com/watch?v=ZMYugRitwjw video])
:  Frank Würthwein, SDSC
:  Frank Würthwein, SDSC


Line 128: Line 129:
|-
|-
|''' 09:00-09:30'''
|''' 09:00-09:30'''
|'''[[Media:LUG2023-LNet_Large_NIDs-Simmons.pdf|LNet Large NID Support]]'''
|'''[[Media:LUG2023-LNet_Large_NIDs-Simmons.pdf|LNet Large NID Support]]''' ([https://m.youtube.com/watch?v=80hK4EVRePw video])
:  James Simmons, ORNL
:  James Simmons, ORNL


|-
|-
|''' 09:30-10:00'''
|''' 09:30-10:00'''
|'''[[Media:LUG2023-ALCF_Community_Storage_Globus-Kulyavtsev.pdf|Community Storage Using Lustre and Globus Sharing]]'''
|'''[[Media:LUG2023-ALCF_Community_Storage_Globus-Kulyavtsev.pdf|Community Storage Using Lustre and Globus Sharing]]''' ([https://www.youtube.com/watch?v=HCiArPAM07Q video])
:  Alex Kulyavtsev, ANL
:  Alex Kulyavtsev, ANL


|-
|-
|''' 10:30-11:00'''
|''' 10:30-11:00'''
|'''[[Media:LUG2023-Metadata_WBC-Drokin.pdf|Metadata Writeback Caching]]'''
|'''[[Media:LUG2023-Metadata_WBC-Drokin.pdf|Metadata Writeback Caching]]''' ([https://m.youtube.com/watch?v=0m14PKV2Nls video])
:  Oleg Drokin, Whamcloud
:  Oleg Drokin, Whamcloud


|-
|-
|''' 11:00-11:30'''
|''' 11:00-11:30'''
|'''[[Media:LUG2023-Fast_IO_El_Capitan_Rabbit_Storage-Faaland.pdf|Fast I/O Through Big, Pointy Teeth: El Capitan and Rabbit Storage]]'''
|'''[[Media:LUG2023-Fast_IO_El_Capitan_Rabbit_Storage-Faaland.pdf|Fast I/O Through Big, Pointy Teeth: El Capitan and Rabbit Storage]]''' ([https://www.youtube.com/watch?v=xccViZtVye4 video])
:  Olaf Faaland, LLNL
:  Olaf Faaland, LLNL


|-
|-
|''' 14:30-14:45'''
|''' 11:30-11:45'''
|'''[[Media:LUG2023-Closing_Remarks.pdf|Closing Remarks]]'''
|'''[[Media:LUG2023-Closing_Remarks.pdf|Closing Remarks]]'''
: Megan Larko, OpenSFS
: Megan Larko, OpenSFS

Revision as of 11:22, 18 September 2023

LUG 2023 was held at the Qualcomm Institute at the University of California San Diego (UCSD) Supercomputing Center (SDSC) May 1st-4th.

LUG 2022 Agenda

Monday, May 1 – Day 0

Developer Day

Tuesday, May 2 – Day 1

09:00-09:30 OpenSFS Welcome Remarks
Sarp Oral, OpenSFS
09:30-10:00 Experiences and Approaches for Supporting Lustre for a Large User Environment (video)
Mahidhar Tatineni, SDSC
10:00-10:30 Community Release Update (video)
Peter Jones, Whamcloud
11:00-11:30 Bringing Lustre to the Masses Through a Fully-managed Cloud Service (video)
Darryl Osborne, Amazon
11:30-12:00 Lustre Client Encrytion (video)
Sebastien Buisson, DDN
13:30-14:00 Understanding Lustre Timeouts (video)
Richard Mohr, ORNL
14:00-14:30 Client-side Data Compression (video)
Colin Faber, Artem Blagodarenko, Whamcloud
15:00-15:30 Experiences with Lustre on Stampede2 and Frontera (video)
Nick Thorne, TACC
16:00-16:30 OpenSFS Update (video)
OpenSFS Board
17:00-19:00 Welcome Reception
OpenSFS

Wednesday, May 3 – Day 2

09:00-09:30 Getting a Balanced, Full Production File System Migration to Work (video)
Cameron Harr, LLNL
09:30-10:00 Managing Cloud HPC with Infrastructure-as-Code (video)
Matthew Vaughn, Amazon
10:30-11:00 Lustre 2.16 and Beyond (video)
Andreas Dilger, Whamcloud


11:00-11:30 Delivering Lustre 2.15 Filesystem as an HPC Cloud Service (video)
Dilip Sundarraj, Microsoft
11:30-12:00 Overview of Kfabric Network Driver, and User Defined Selection Policy (video)
Chris Horn, HPE
13:00-13:30 Sponsor Talk: Maximizing At-Scale AI Training Efficiency (video)
Raphael Druon, DDN
13:30-14:00 The Orion File System: Configuration and Performance (video)
Richard Mohr, ORNL
14:30-15:00 Unaligned Direct I/O (video)
Patrick Farrell, Whamcloud
15:00-15:30 Secure Namespace Isolation in Lustre (video)
Shuichi Ihara, Sebastien Buisson, DDN
16:00-16:30 The PoliMOR Policy Engine: Improvements and Performance Results (video)
Christopher Brumgard, ORNL
16:30-17:00 Invited Talk: Prototype National Research Platform (video)
Frank Würthwein, SDSC
17:30-20:30 Ballast Point Social Event
Aeon Computing, DDN, Habana Labs

Thursday, May 4 – Day 3

09:00-09:30 LNet Large NID Support (video)
James Simmons, ORNL
09:30-10:00 Community Storage Using Lustre and Globus Sharing (video)
Alex Kulyavtsev, ANL
10:30-11:00 Metadata Writeback Caching (video)
Oleg Drokin, Whamcloud
11:00-11:30 Fast I/O Through Big, Pointy Teeth: El Capitan and Rabbit Storage (video)
Olaf Faaland, LLNL
11:30-11:45 Closing Remarks
Megan Larko, OpenSFS