Lustre User Group 2014: Difference between revisions

From Lustre Wiki
Jump to navigation Jump to search
m (→‎LUG 2014 Agenda: fix URLs)
m (→‎LUG 2014 Agenda: fix internal link names)
Line 24: Line 24:
|-
|-
|'''Sessions 1 and 2'''
|'''Sessions 1 and 2'''
|'''''[[Media:LUG2014-TransitioningOpenSFStoaCommunityNexus.pdf OpenSFS Community]] [https://www.youtube.com/watch?v=1D99n9p6LUg Video] and [[Media:LUG2014-EOFSUpdate.pdf EOFS Update]] [https://www.youtube.com/watch?v=iPNFqQQZhbM Video]'''''
|'''''[[Media:LUG2014-TransitioningOpenSFStoaCommunityNexus.pdf|OpenSFS Community]] [https://www.youtube.com/watch?v=1D99n9p6LUg Video] and [[Media:LUG2014-EOFSUpdate.pdf|EOFS Update]] [https://www.youtube.com/watch?v=iPNFqQQZhbM Video]'''''
:Galen Shipman, OpenSFS and Hugo Falter, EOFS
:Galen Shipman, OpenSFS and Hugo Falter, EOFS
|-
|-
|'''Session 3'''
|'''Session 3'''
|'''''[[Media:LUG2014-LustreReleases-Morrone.pdf Lustre Releases]]'''''
|'''''[[Media:LUG2014-LustreReleases-Morrone.pdf|Lustre Releases]]'''''
:Christopher Morrone, OpenSFS  [https://www.youtube.com/watch?v=_ice_2muJbw Video]
:Christopher Morrone, OpenSFS  [https://www.youtube.com/watch?v=_ice_2muJbw Video]
|-
|-
|'''Session 4'''
|'''Session 4'''
|'''''[[Media:LUG2014-LustreClientPerformanceComparisonandTuning-Fragalla.pdf Lustre Client Performance Comparison and Tuning]]'''''
|'''''[[Media:LUG2014-LustreClientPerformanceComparisonandTuning-Fragalla.pdf|Lustre Client Performance Comparison and Tuning]]'''''
:John Fragalla, Xyratex  [https://www.youtube.com/watch?v=tzAYmhH6KoY Video]
:John Fragalla, Xyratex  [https://www.youtube.com/watch?v=tzAYmhH6KoY Video]
|-
|-
|'''Session 5'''
|'''Session 5'''
|'''''[[Media:LUG2014-MovingLustreForwardWhatWeveLearnedandWhatsComing-Gorda.pdf Moving Lustre Forward – What We’ve Learned and What’s Coming]]''''
|'''''[[Media:LUG2014-MovingLustreForwardWhatWeveLearnedandWhatsComing-Gorda.pdf|Moving Lustre Forward – What We’ve Learned and What’s Coming]]''''
:Brent Gorda, Intel [https://www.youtube.com/watch?v=gi7_nKsmVYA Video]
:Brent Gorda, Intel [https://www.youtube.com/watch?v=gi7_nKsmVYA Video]
|-
|-
|'''Session 6'''
|'''Session 6'''
|'''''[[Media:LUG2014-LustreClientIOPerformanceImprovements-Uselton.pdf Lustre Client IO Performance Improvements]]'''''
|'''''[[Media:LUG2014-LustreClientIOPerformanceImprovements-Uselton.pdf|Lustre Client IO Performance Improvements]]'''''
:Andrew Usleton, Intel  [https://www.youtube.com/watch?v=mDOEM_4IpII Video]
:Andrew Usleton, Intel  [https://www.youtube.com/watch?v=mDOEM_4IpII Video]
|-
|-
|'''Session 7'''
|'''Session 7'''
|'''''[[Media:LUG2014-XyratexUpdate-Connolly.pdf Xyratex Update]] (Lustre acquisition, futures, etc.)'''''
|'''''[[Media:LUG2014-XyratexUpdate-Connolly.pdf|Xyratex Update]] (Lustre acquisition, futures, etc.)'''''
:Michael Connolly, Xyratex  [https://www.youtube.com/watch?v=6v6cWQF8mOU Video]
:Michael Connolly, Xyratex  [https://www.youtube.com/watch?v=6v6cWQF8mOU Video]
|-
|-
|'''Session 8'''
|'''Session 8'''
|'''''[[Media:LUG2014-Lustre2.5PerformanceEvaluation-Ihara.pdf Lustre 2.5 Performance Evaluation: Performance Improvements with Large I/O Patches,]]'''''
|'''''[[Media:LUG2014-Lustre2.5PerformanceEvaluation-Ihara.pdf|Lustre 2.5 Performance Evaluation: Performance Improvements with Large I/O Patches,]]'''''
:'''''[[Media:LUG2014-Lustre2.5PerformanceEvaluation-Ihara.pdf Metadata Improvements, and Metadata Scaling with DNE]]'''''
:'''''[[Media:LUG2014-Lustre2.5PerformanceEvaluation-Ihara.pdf|Metadata Improvements, and Metadata Scaling with DNE]]'''''
:Hitoshi Sato, TITECH and Shuichi Ihara, DDN  [https://www.youtube.com/watch?v=_CJh6ue-N3c Video]
:Hitoshi Sato, TITECH and Shuichi Ihara, DDN  [https://www.youtube.com/watch?v=_CJh6ue-N3c Video]
|-
|-
|'''Session 9'''
|'''Session 9'''
|'''''[[Media:LUG2014-Future_Features-Andreas.pdf Lustre Future Features]]'''''
|'''''[[Media:LUG2014-Future_Features-Andreas.pdf|Lustre Future Features]]'''''
:Andreas Dilger, Intel  [https://www.youtube.com/watch?v=76ZRTFlw7_4 Video]
:Andreas Dilger, Intel  [https://www.youtube.com/watch?v=76ZRTFlw7_4 Video]
|-
|-
|'''Session 10.1'''
|'''Session 10.1'''
|'''''[[Media:LUG2014-DataOnMDT-Pershin.pdf Lustre Data-on-MDT/Small File I/O]]'''''
|'''''[[Media:LUG2014-DataOnMDT-Pershin.pdf|Lustre Data-on-MDT/Small File I/O]]'''''
:Mike Pershin, Intel [https://www.youtube.com/watch?v=JeVPw53_pe8 Video]
:Mike Pershin, Intel [https://www.youtube.com/watch?v=JeVPw53_pe8 Video]
|-
|-
|'''Session 10.2'''
|'''Session 10.2'''
|'''''[[Media:LUG2014-Layout_Enhancement-Hammond.pdf Lustre Layout Enhancement]]'''''
|'''''[[Media:LUG2014-Layout_Enhancement-Hammond.pdf|Lustre Layout Enhancement]]'''''
:John Hammond, Intel [https://www.youtube.com/watch?v=G2AuiyfmLLg Video]
:John Hammond, Intel [https://www.youtube.com/watch?v=G2AuiyfmLLg Video]
|-
|-
|'''Session 10.3'''
|'''Session 10.3'''
|'''''[[Media:LUG2014-File_Level_Replication-Xiong.pdf Lustre File Level Replication]]'''''
|'''''[[Media:LUG2014-File_Level_Replication-Xiong.pdf|Lustre File Level Replication]]'''''
:Jinshan Xiong, Intel [https://www.youtube.com/watch?v=7530Kfj7Uco Video]
:Jinshan Xiong, Intel [https://www.youtube.com/watch?v=7530Kfj7Uco Video]
|-
|-
|'''Session 11'''
|'''Session 11'''
|'''''[[Media:LUG2014-OpenSFS_Lustre_HSM_Update-Cray.pdf OpenSFS, Lustre, and HSM: an update from Cray]]'''''
|'''''[[Media:LUG2014-OpenSFS_Lustre_HSM_Update-Cray.pdf|OpenSFS, Lustre, and HSM: an update from Cray]]'''''
:Cory Spitz and Jason Goodman, Cray  [https://www.youtube.com/watch?v=xGvwi2Zh1Lg Video]
:Cory Spitz and Jason Goodman, Cray  [https://www.youtube.com/watch?v=xGvwi2Zh1Lg Video]
|-
|-
|'''Session 12'''
|'''Session 12'''
|'''''[[Media:LUG2014-QuotasForProjects-Ihara.pdf Quotas for Projects: A Proposed New Feature]]'''''
|'''''[[Media:LUG2014-QuotasForProjects-Ihara.pdf|Quotas for Projects: A Proposed New Feature]]'''''
:Shuichi Ihara, DDN  [https://www.youtube.com/watch?v=OH0Pqc4ZhGI Video]
:Shuichi Ihara, DDN  [https://www.youtube.com/watch?v=OH0Pqc4ZhGI Video]
|-
|-
|'''Session 13'''
|'''Session 13'''
|'''''[[Media:LUG2014-DynamicLNETConfiguration-Amir.pdf Dynamic LNET Config]]'''''
|'''''[[Media:LUG2014-DynamicLNETConfiguration-Amir.pdf|Dynamic LNET Config]]'''''
:Amir Shehata, Intel  [https://www.youtube.com/watch?v=XgAVS5Q1M_k Video]
:Amir Shehata, Intel  [https://www.youtube.com/watch?v=XgAVS5Q1M_k Video]
|-
|-
|'''Session 14'''
|'''Session 14'''
|'''''[[Media:LUG2014-LLNLProductionPlansandBestPractices-Stearman.pdf LLNL – Production Plans and Best Practices]]'''''
|'''''[[Media:LUG2014-LLNLProductionPlansandBestPractices-Stearman.pdf|LLNL – Production Plans and Best Practices]]'''''
:Marc Stearman, Lawrence Livermore National Laboratory  [https://www.youtube.com/watch?v=s8KNAHLAMnc Video]
:Marc Stearman, Lawrence Livermore National Laboratory  [https://www.youtube.com/watch?v=s8KNAHLAMnc Video]
|-
|-
Line 90: Line 90:
|-
|-
|'''Session 15'''
|'''Session 15'''
|'''''[[Media:LUG2014-StateofLustre-MacLelland.pdf The First Lustre Annual State of the Lustre Community]]'''''
|'''''[[Media:LUG2014-StateofLustre-MacLelland.pdf|The First Lustre Annual State of the Lustre Community]]'''''
:Meghan McClelland, OpenSFS  [https://www.youtube.com/watch?v=dlcvbH2e-bI Video]
:Meghan McClelland, OpenSFS  [https://www.youtube.com/watch?v=dlcvbH2e-bI Video]
|-
|-
|'''Session 16'''
|'''Session 16'''
|'''''[[Media:LUG2014-PLFSandLustrePerformanceComparison-LANL.pdf PLFS and Lustre Performance Comparison]]'''''
|'''''[[Media:LUG2014-PLFSandLustrePerformanceComparison-LANL.pdf|PLFS and Lustre Performance Comparison]]'''''
:Brett Kettering, Los Alamos National Laboratory  [https://www.youtube.com/watch?v=WS_mtS4uQe8 Video]
:Brett Kettering, Los Alamos National Laboratory  [https://www.youtube.com/watch?v=WS_mtS4uQe8 Video]
|-
|-
|'''Session 17'''
|'''Session 17'''
|'''''[[Media:LUG2014-RunningNativeLustreClientInsideXeonPhi-Zhiqi_Dmitry.pdf Running Native Lustre Client inside Xeon Phi]]'''''
|'''''[[Media:LUG2014-RunningNativeLustreClientInsideXeonPhi-Zhiqi_Dmitry.pdf|Running Native Lustre Client inside Xeon Phi]]'''''
:Dmitry Eremin and Zhiqi Tao, Intel  [https://www.youtube.com/watch?v=SanVfp3p1ws Video]
:Dmitry Eremin and Zhiqi Tao, Intel  [https://www.youtube.com/watch?v=SanVfp3p1ws Video]
|-
|-
|'''Session 18'''
|'''Session 18'''
|'''''[[Media:LUG2014-IntegratingArrayManagementIntoLustre-SFW.pdf Integrating Array Management into Lustre]]'''''
|'''''[[Media:LUG2014-IntegratingArrayManagementIntoLustre-SFW.pdf|Integrating Array Management into Lustre]]'''''
:Roger Ronald and Kevin Moran, System Fabric Works  [https://www.youtube.com/watch?v=76ZRTFlw7_4 Video]
:Roger Ronald and Kevin Moran, System Fabric Works  [https://www.youtube.com/watch?v=76ZRTFlw7_4 Video]
|-
|-
Line 110: Line 110:
|-
|-
|'''Session 20'''
|'''Session 20'''
|'''''[[Media:LUG2014-LustreZFSHybridSystems-Judd.pdf Practical Applications of Lustre/ZFS Hybrid Systems]]'''''
|'''''[[Media:LUG2014-LustreZFSHybridSystems-Judd.pdf|Practical Applications of Lustre/ZFS Hybrid Systems]]'''''
:Josh Judd, Warp Mechanics  [https://www.youtube.com/watch?v=j4gQBLZ1On4 Video]
:Josh Judd, Warp Mechanics  [https://www.youtube.com/watch?v=j4gQBLZ1On4 Video]
|-
|-
|'''Session 21'''
|'''Session 21'''
|'''''[[Media:LUG2014-CollectiveIO_Exascale_Applications-Xyratex.pdf Collective I/O for Exascale I/O Intensive Applications]]'''''
|'''''[[Media:LUG2014-CollectiveIO_Exascale_Applications-Xyratex.pdf|Collective I/O for Exascale I/O Intensive Applications]]'''''
:Sai Narasimhamurthy, Xyratex  [https://www.youtube.com/watch?v=uSo0K82E3e0 Video]
:Sai Narasimhamurthy, Xyratex  [https://www.youtube.com/watch?v=uSo0K82E3e0 Video]
|-
|-
|'''Session 22'''
|'''Session 22'''
|'''''[[Media:LUG2014-SSDProvisioningforExascale-ORNL.pdf SSD Provisioning for Exascale Storage Systems: When, Where and How much?]]'''''
|'''''[[Media:LUG2014-SSDProvisioningforExascale-ORNL.pdf|SSD Provisioning for Exascale Storage Systems: When, Where and How much?]]'''''
:Devesh Tiwari, Oak Ridge National Laboratory  [https://www.youtube.com/watch?v=mvbNDtUhC-Y Video]
:Devesh Tiwari, Oak Ridge National Laboratory  [https://www.youtube.com/watch?v=mvbNDtUhC-Y Video]
|-
|-
Line 126: Line 126:
|-
|-
|'''Session 24'''
|'''Session 24'''
|'''''[[Media:LUG2014-DistributedBurstBufferSystemForLustre-ORNL.pdf An efficient distributed burst buffer system for Lustre]]'''''
|'''''[[Media:LUG2014-DistributedBurstBufferSystemForLustre-ORNL.pdf|An efficient distributed burst buffer system for Lustre]]'''''
:Bradley Settlemyer, Oak Ridge National Laboratory  [https://www.youtube.com/watch?v=SBgv9D48Occ Video]
:Bradley Settlemyer, Oak Ridge National Laboratory  [https://www.youtube.com/watch?v=SBgv9D48Occ Video]
|-
|-
|'''Session 25'''
|'''Session 25'''
|'''''[[Media:LUG2014-Lustre_Beyond_HPC-Triendl.pdf Lustre for the Real World: Experiences with Lustre Beyond Standard HPC Applications]]'''''
|'''''[[Media:LUG2014-Lustre_Beyond_HPC-Triendl.pdf|Lustre for the Real World: Experiences with Lustre Beyond Standard HPC Applications]]'''''
:Robert Triendl, DDN  [https://www.youtube.com/watch?v=Vmbn8Di71eI Video]
:Robert Triendl, DDN  [https://www.youtube.com/watch?v=Vmbn8Di71eI Video]
|-
|-
Line 140: Line 140:
|-
|-
|'''Session 27'''
|'''Session 27'''
|'''''[[Media:LUG2014-Server_Storage_Side_Caching-DDN.pdf Lustre File System Acceleration Using Server or Storage-Side Caching]]'''''
|'''''[[Media:LUG2014-Server_Storage_Side_Caching-DDN.pdf|Lustre File System Acceleration Using Server or Storage-Side Caching]]'''''
:James Coomer, DDN  [https://www.youtube.com/watch?v=riIzS-N0pgY Video]
:James Coomer, DDN  [https://www.youtube.com/watch?v=riIzS-N0pgY Video]
|-
|-
Line 149: Line 149:
|-
|-
|'''Session 28'''
|'''Session 28'''
|'''''[[Media:LUG2014-Hadoop_Map_Reduce_on_Lustre-Zhiqi.pdf Run Hadoop Map Reduce Jobs on Lustre]]'''''
|'''''[[Media:LUG2014-Hadoop_Map_Reduce_on_Lustre-Zhiqi.pdf|Run Hadoop Map Reduce Jobs on Lustre]]'''''
:Zhiqi Tao, Intel  [https://www.youtube.com/watch?v=sFXUst2fqp0 Video]
:Zhiqi Tao, Intel  [https://www.youtube.com/watch?v=sFXUst2fqp0 Video]
|-
|-
|'''Session 29'''
|'''Session 29'''
|'''''[[Media:LUG2014-Integration_Lustre_Hadroop_YARN-Weikuan_Omkar.pdf Progress Report on Efficient Integration of Lustre and Hadoop/YARN]]'''''
|'''''[[Media:LUG2014-Integration_Lustre_Hadroop_YARN-Weikuan_Omkar.pdf|Progress Report on Efficient Integration of Lustre and Hadoop/YARN]]'''''
:Weikuan Yu, Auburn University and Omkar Kulkarni, Intel  [https://www.youtube.com/watch?v=bxJCvRJaGgs Video]
:Weikuan Yu, Auburn University and Omkar Kulkarni, Intel  [https://www.youtube.com/watch?v=bxJCvRJaGgs Video]
|-
|-
Line 161: Line 161:
|-
|-
|'''Session 31'''
|'''Session 31'''
|'''''[[Media:LUG2014-Monitoring_with_Lustre_Jobstat-DDN_ANU.pdf Fine-grained File System Monitoring with Lustre Jobstat]]'''''
|'''''[[Media:LUG2014-Monitoring_with_Lustre_Jobstat-DDN_ANU.pdf|Fine-grained File System Monitoring with Lustre Jobstat]]'''''
:Patrick Fitzhenry, DDN and Daniel Rodwell, Australian National University  [https://www.youtube.com/watch?v=wCgdVIP4Tp0 Video]
:Patrick Fitzhenry, DDN and Daniel Rodwell, Australian National University  [https://www.youtube.com/watch?v=wCgdVIP4Tp0 Video]
|-
|-
|'''Session 32'''
|'''Session 32'''
|'''''[[Media:LUG2014-LustreLogAnalyzer-Kalpak.pdf Lustre Log Analyzer: A Community-centric Effort to Improve Lustre Log Analysis]]'''''
|'''''[[Media:LUG2014-LustreLogAnalyzer-Kalpak.pdf|Lustre Log Analyzer: A Community-centric Effort to Improve Lustre Log Analysis]]'''''
:Kalpak Shah, DDN  [https://www.youtube.com/watch?v=ybKlGydc45c Video]
:Kalpak Shah, DDN  [https://www.youtube.com/watch?v=ybKlGydc45c Video]
|-
|-
|}
|}

Revision as of 02:59, 26 December 2016

This is a stub page to facilitate contribution of information and presentations.

LUG 2014 was held in Miami, Florida, from April 8-10, 2014.

OpenSFS, in collaboration with EOFS, is proud to host the 12th annual Lustre User Group (LUG) conference. LUG continues to be the primary venue for discussion and seminars on the Lustre® parallel file system and other open source file system technologies. The event will include more than 50 sessions and panels, where attendees have the opportunity to:

· Hear from the world's leading developers, administrators, solution providers, and users of Lustre

· Be an active participant in industry dialogue on best practices and emerging technologies

· Explore upcoming developments of the Lustre file system

· Immerse in the strong Lustre community, working collaboratively to further the development of Lustre


As one of the many benefits of being a member of OpenSFS - the organization that drives HPC open source file system community efforts - OpenSFS is pleased to offer one complimentary pass to each current member entity of OpenSFS. Details are coming soon with the opening of the LUG 2014 registration site.

The venue for LUG 2014 is the Miami Marriott Biscayne Bay, located right on Biscayne Bay and just minutes from South Beach and other famous Miami attractions. Please visit the LUG 2013 web page to view the agenda and caliber of presentations of past LUG events. With the ongoing growth and outstanding progress of Lustre, the 2014 event promises to be exciting and informative.

LUG 2014 Agenda

Day 1 – April 8

Sessions 1 and 2 OpenSFS Community Video and EOFS Update Video
Galen Shipman, OpenSFS and Hugo Falter, EOFS
Session 3 Lustre Releases
Christopher Morrone, OpenSFS Video
Session 4 Lustre Client Performance Comparison and Tuning
John Fragalla, Xyratex Video
Session 5 Moving Lustre Forward – What We’ve Learned and What’s Coming'
Brent Gorda, Intel Video
Session 6 Lustre Client IO Performance Improvements
Andrew Usleton, Intel Video
Session 7 Xyratex Update (Lustre acquisition, futures, etc.)
Michael Connolly, Xyratex Video
Session 8 Lustre 2.5 Performance Evaluation: Performance Improvements with Large I/O Patches,
Metadata Improvements, and Metadata Scaling with DNE
Hitoshi Sato, TITECH and Shuichi Ihara, DDN Video
Session 9 Lustre Future Features
Andreas Dilger, Intel Video
Session 10.1 Lustre Data-on-MDT/Small File I/O
Mike Pershin, Intel Video
Session 10.2 Lustre Layout Enhancement
John Hammond, Intel Video
Session 10.3 Lustre File Level Replication
Jinshan Xiong, Intel Video
Session 11 OpenSFS, Lustre, and HSM: an update from Cray
Cory Spitz and Jason Goodman, Cray Video
Session 12 Quotas for Projects: A Proposed New Feature
Shuichi Ihara, DDN Video
Session 13 Dynamic LNET Config
Amir Shehata, Intel Video
Session 14 LLNL – Production Plans and Best Practices
Marc Stearman, Lawrence Livermore National Laboratory Video

Day 2 – April 9

Session 15 The First Lustre Annual State of the Lustre Community
Meghan McClelland, OpenSFS Video
Session 16 PLFS and Lustre Performance Comparison
Brett Kettering, Los Alamos National Laboratory Video
Session 17 Running Native Lustre Client inside Xeon Phi
Dmitry Eremin and Zhiqi Tao, Intel Video
Session 18 Integrating Array Management into Lustre
Roger Ronald and Kevin Moran, System Fabric Works Video
Session 19 Metadata Benchmarks and MD Performance Metrics
Sorin Faibish, EMC Video
Session 20 Practical Applications of Lustre/ZFS Hybrid Systems
Josh Judd, Warp Mechanics Video
Session 21 Collective I/O for Exascale I/O Intensive Applications
Sai Narasimhamurthy, Xyratex Video
Session 22 SSD Provisioning for Exascale Storage Systems: When, Where and How much?
Devesh Tiwari, Oak Ridge National Laboratory Video
Session 23 Exascale Computing Vision
Eric Barton, Intel Video
Session 24 An efficient distributed burst buffer system for Lustre
Bradley Settlemyer, Oak Ridge National Laboratory Video
Session 25 Lustre for the Real World: Experiences with Lustre Beyond Standard HPC Applications
Robert Triendl, DDN Video
Session 26 Panel: 2020 HPC Platform Architectures and their Impact on Storage
Panelists: Al Geist, Oak Ridge National Laboratory, Rob Ross, MCS, ANL,
Lee Ward, Sandia National Laboratory, Terri Quinn, Lawrence Livermore National Laboratory
Moderator: Steve Simms, Indiana University Video
Session 27 Lustre File System Acceleration Using Server or Storage-Side Caching
James Coomer, DDN Video

Day 3 – April 10

Session 28 Run Hadoop Map Reduce Jobs on Lustre
Zhiqi Tao, Intel Video
Session 29 Progress Report on Efficient Integration of Lustre and Hadoop/YARN
Weikuan Yu, Auburn University and Omkar Kulkarni, Intel Video
Session 30 OpenSFS Benchmarking Working Group Filesystem Monitoring Task Effort
Andrew Uselton. Intel Video
Session 31 Fine-grained File System Monitoring with Lustre Jobstat
Patrick Fitzhenry, DDN and Daniel Rodwell, Australian National University Video
Session 32 Lustre Log Analyzer: A Community-centric Effort to Improve Lustre Log Analysis
Kalpak Shah, DDN Video
Retrieved from "http://wiki.lustre.org/index.php?title=Lustre_User_Group_2014&oldid=2049"