Lustre User Group 2015: Difference between revisions

From Lustre Wiki
Jump to navigation Jump to search
(Initial Creation)
 
(adding main site link & page structure update)
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:


Day 1 – Monday, April 13
OpenSFS was proud to host LUG 2015 in Denver, Colorado on April 13-15, 2015
* Welcome Remarks and Lustre 101 Stephen Simms, LUG Program Chair
* [http://opensfs.org/events/lug-2015/ OpenSFS LUG 2015 Site]
* OpenSFS Update Charlie Carroll, Cray,
* EOFS Update Hugo Falter, EOFS 
* Demo: Installing Lustre 2.7 via RPM Brian Andrus from the ITACS/Research Computing Naval Postgraduate School 
* Lustre Development Update Christoper Morrone, OpenSFS/LLNL   
* Lustre + Linux – Putting the House in Order James Simmons,ORNL 
* Cray’s Storage History and Outlook – Lustre+ Jason Goodman, Cray   
* From Lab to Enterprise – Growing the Lustre Ecosystem Malcolm Cowe, Intel
* SDSC’s Data Oasis Gen II: ZFS, 40GbE, and Replication Rick Wagner, San Diego Supercomputer Center 
* There and Back Again – The Battle of Lustre at LANL Kyle Lamb, Michael Masson, and Susan CoulterLANL
* Seagate Lustre Update Peter Bojanic,Seagate Technology
* Lustre & Kerberos: In Theory and In Practice Sebastien Buisson, Bull
* GSS Shared Key Update and Using UID Mapping in Lustre 2.7 Steve Simms, Indiana University
* ZFS as Backend File System for Lustre:  Current Status, How to Optimize, Where to Improve Gabriele Paciucci Intel 
* Per User Lustre File Systems Leveraging ZFS Pools Marc Stearman, LLNL 


Day 2 – Tuesday, April 14
== Presentations ==
* Lustre 2.8 and Beyond Andreas Dilger, Intel 
* Progressive File Layouts John Hammond, Intel; Jason Hill, ORNL
* Intelligent Cache Hinting in Lustre Micah Bhakti, Intel
* Intel and Lustre: ­ Growth of Lustre Adoption and Intel’s Continued Commitment Brent Gorda, Intel
* Lustre HSM in the cloud Robert Read, Intel
* Application-optimized Lustre Solutions for Big-Data Workflows Robert Triendl, DDN
* Metadata Access Reduction and Analysis and Elimination of Client Evictions on a Large Scale Lustre Based File System Keiji Yamamoto, RIKEN AICS; Shinji Sumimoto, Fujitsu
* Lustre Network (LNET) Router Configuration and Tuning John Fragalla, Seagate Technology
* Towards continuous 24x7x365 production operation on a router-less 20 petabyte, 11,200 node cluster-or-Defending the Planet with Lustre: Your life could depend on it! Bob Ciotti, NASA
* Lustre Metrics: NewTechniques for Monitoring Lustre Scott Nolin, Andrew Wagner, UW Space Science and Engineering Center 
* New and Improved Lustre Performance Monitoring Tool Torben Kling Petersen, Seagate Technology
* Correlating Multiple TB of I/O Performance Data to User Jobs Michael Kluge, ZIH
* Monitoring a Heterogeneous Lustre environment Frédérick Lefebvre, Calcul Quebec Universite Laval


Day 3 – Wednesday, April 15
* Welcome Remarks and Lustre 101, Stephen Simms, LUG Program Chair
* Reliability of NVM devices for I/O acceleration on supercomputing systems Hitoshi Sato, Tokyo Institute of Technology
** [[Media:Lustre-Overview-for-Newcomers_Simms.pdf|Slides]]
* Scalability Testing of DNE2 in Lustre 2.7 Stephen Simms, Indiana University
** [http://insidehpc.com/2015/04/video-steve-simms-teaches-lustre-101-lug-2015/ Video]
* Shared File Performance in Lustre: Challenges and Solutions Patrick Farrell, Cray
* OpenSFS Update, Charlie Carroll, Cray,
* OSD-Btrfs, a Novel Lustre OSD based on Btrfs Shuichi Ihara, Li Xi, DDN
** [http://wp.me/p3RLHQ-e1z Video]
* Deploying Hadoop on Lustre Storage: Lessons learned and best practices J.Mario Gallegos, Dell; Zhiqi Tao, Intel
* EOFS Update, Hugo Falter, EOFS
* Understanding Hadoop Performance on Lustre Stephen Skory, Seagate Technology
** [[Media:EOFS_Status-Report_Falter.pdf|Slides]]
** [http://insidehpc.com/2015/04/video-eofs-update-lug-2015/ Video]
* Demo: Installing Lustre 2.7 via RPM, Brian Andrus from the ITACS/Research Computing Naval Postgraduate School
** [[Media:Lustre-101_Andrus.pdf|Slides]]
** [https://www.youtube.com/watch?v=16UHNhwTMqs Video]
* Lustre Development Update, Christoper Morrone, OpenSFS/LLNL
** [[Media:Lustre_Development_Update_Morrone.pdf|Slides]]
** [http://insidehpc.com/2015/04/video-lustre-development-update-lug-2015/ Video]
* Lustre + Linux – Putting the House in Order, James Simmons,ORNL
** [[Media:Status-of-Linux-Upstream-Lustre-Client_Simmons.pdf|Slides]]
** [https://www.youtube.com/watch?v=sa-eFDRdND8 Video]
* Cray’s Storage History and Outlook – Lustre+, Jason Goodman, Cray
** [[Media:Cray-Sponsor-Presentation_Goodman.pdf|Slides]]
** [https://youtu.be/QQoLuyYVnDc Video]
* From Lab to Enterprise – Growing the Lustre Ecosystem, Malcolm Cowe, Intel
** [[Media:From-Lab-to-Enterprise_Cowe.pdf|Slides]]
** [http://youtu.be/QIO2nXX8dfk Video]
* SDSC’s Data Oasis Gen II: ZFS, 40GbE, and Replication, Rick Wagner, San Diego Supercomputer Center
** [[Media:SDSC-Data-Oasis-GEn-II_Wagner.pdf|Slides]]
** [http://insidehpc.com/2015/04/video-sdscs-data-oasis-gen-ii-zfs-40gbe-replication/ Video]
* There and Back Again – The Battle of Lustre at LANL, Kyle Lamb, Michael Masson, and Susan CoulterLANL
** [[Media:There-and-back-again_LANL1.pdf|Slides]]
** [https://www.youtube.com/watch?v=Q-LmYN4WE1s Video]
* Seagate Lustre Update, Peter Bojanic,Seagate Technology
** [[Media:LUG-2015-Seagate-v2.pdf|Slides]]
** [http://wp.me/p3RLHQ-e2g Video]
* Lustre & Kerberos: In Theory and In Practice, Sebastien Buisson, Bull
** [[Media:Lustre-and-Kerberos_Buisson.pdf|Slides]]
** [https://www.youtube.com/watch?v=_f7rSIADXuo Video]
* GSS Shared Key Update and Using UID Mapping in Lustre 2.7, Steve Simms, Indiana University
** [[Media:GSS-Shard-key-Update-and-Using-UID_Simms.pdf|Slides]]
** [http://youtu.be/FJRr79RzwZw Video]
* ZFS as Backend File System for Lustre:  Current Status, How to Optimize, Where to Improve, Gabriele Paciucci Intel
** [[Media:ZFS-As-Backend-File-System_Paciucci.pdf|Slides]]
** [https://www.youtube.com/watch?v=WXAG7ht1kic Video]
* Per User Lustre File Systems Leveraging ZFS Pools, Marc Stearman, LLNL
** [[Media:Per-User-Lustre-File-Systems-Leveraging-ZFS_Stearman.pdf|Slides]]
** [http://youtu.be/yJI37f3ZM_M Video]
* Lustre 2.8 and Beyond, Andreas Dilger, Intel
** [[Media:Lustre-2.8-and-Beyond_Dilger.pdf|Slides]]
** [https://www.youtube.com/watch?v=GmAiT-g8448 Video]
* Progressive File Layouts, John Hammond, Intel; Jason Hill, ORNL
** [[Media:Progressive-File-Layouts_Hammond.pdf|Slides]]
** [https://www.youtube.com/watch?v=5rm6Nlmqdp0 Video]
* Intelligent Cache Hinting in Lustre, Micah Bhakti, Intel
** [[Media:Intelligent-Cache-Hinting_Bhakti.pdf|Slides]]
** [https://www.youtube.com/watch?v=CUTqGSh4Zek Video]
* Intel and Lustre: ­ Growth of Lustre Adoption and Intel’s Continued Commitment, Brent Gorda, Intel
** [[Media:BGorda-2015-04-14-LUG-v9.pdf|Slides]]
** [https://www.youtube.com/watch?v=C8lv3cAEleY Video]
* Lustre HSM in the cloud, Robert Read, Intel
** [[Media:Lustre-HSM-in-the-Cloud_Read.pdf|Slides]]
** [https://www.youtube.com/watch?v=zACHVrHDsLU Video]
* Application-optimized Lustre Solutions for Big-Data Workflows, Robert Triendl, DDN
** [[Media:LUG-Presentation-Final_Triendl.pdf|Slides]]
** [http://youtu.be/ZGETY9Yu0Js Video]
* Metadata Access Reduction and Analysis and Elimination of Client Evictions on a Large Scale Lustre Based File System, Keiji Yamamoto, RIKEN AICS; Shinji Sumimoto, Fujitsu
** [[Media:Metadata-Access-Reduction-and-Analaysis_Yamamoto_Sumimoto.pdf|Slides]]
** [https://www.youtube.com/watch?v=GiYc-BRQ4Yw Video]
* Lustre Network (LNET) Router Configuration and Tuning, John Fragalla, Seagate Technology
** [[Media:Lustre-Network-Router-Config_Fragalla.pdf|Slides]]
** [http://youtu.be/bm_uPtNsd1Y Video]
* Towards continuous 24x7x365 production operation on a router-less 20 petabyte, 11,200 node cluster-or-Defending the Planet with Lustre: Your life could depend on it!, Bob Ciotti, NASA
** [[Media:Towards-Continuous-Production-Operation_Ciotti.pdf|Slides]]
** [http://insidehpc.com/2015/04/video-defending-planet-lustre/ Video]
* Lustre Metrics: NewTechniques for Monitoring Lustre, Scott Nolin, Andrew Wagner, UW Space Science and Engineering Center
** [[Media:Lustre-Metrics-New-Techniques-for-Monitoring_Nolin_Wagner.pdf|Slides]]
** [https://youtu.be/iM6fW4oxBm4 Video]
* New and Improved Lustre Performance Monitoring Tool, Torben Kling Petersen, Seagate Technology
** [[Media:New-and-Improved-Lustre-Performance-Monitoring-Tool_Kling-Peterson.pdf|Slides]]
** [http://youtu.be/CjLYuGFscuw Video]
* Correlating Multiple TB of I/O Performance Data to User Jobs, Michael Kluge, ZIH
** [[Media:folien_lug_2015_michael_kluge-3.pdf|Slides]]
** [https://youtu.be/ETcvobMpcHc Video]
* Monitoring a Heterogeneous Lustre environment, Frédérick Lefebvre, Calcul Quebec Universite Laval
** [[Media:Monitoring-an-heterogenous-Lustre-environment_Lefebvre.pdf|Slides]]
** [https://youtu.be/F37B8Uu7Muc Video]
* Reliability of NVM devices for I/O acceleration on supercomputing systems, Hitoshi Sato, Tokyo Institute of Technology
** [[Media:Reliability-of-NVM-Devices_Sato.pdf|Slides]]
** [http://youtu.be/neYR2OLzRMs Video]
* Scalability Testing of DNE2 in Lustre 2.7, Stephen Simms, Indiana University
** [[Media:Scalability-Testing-of-DNE2-in-Lustre-27_Simms_V2.pdf|Slides]]
* Shared File Performance in Lustre: Challenges and Solutions, Patrick Farrell, Cray
** [[Media:Shared-File-Performance-in-Lustre_Farrell.pdf|Slides]]
** [http://youtu.be/ITfZfV5QzIs Video]
* OSD-Btrfs, a Novel Lustre OSD based on Btrfs, Shuichi Ihara, Li Xi, DDN
** [[Media:OSD-Btrfs-a-Novel-Lustre-OSD_Ihara_Xi.pdf|Slides]]
** [http://youtu.be/aOHqIj2bOw4 Video]
* Deploying Hadoop on Lustre Storage: Lessons learned and best practices, J.Mario Gallegos, Dell; Zhiqi Tao, Intel
** [[Media:Deploying-Hadoop-on-Lustre-Storage_Gallegos_Tao_v2.pdf|Slides]]
** [http://youtu.be/sFNgf5s-bcc Video]
* Understanding Hadoop Performance on Lustre, Stephen Skory, Seagate Technology
** [[Media:Understanding-Hadoop-on-Lustre-Performance_Skory.pdf|Slides]]
** [http://youtu.be/VaeHt9IMM9o Video]
 
[[Category: Events]]

Latest revision as of 07:50, 2 December 2016

OpenSFS was proud to host LUG 2015 in Denver, Colorado on April 13-15, 2015

Presentations

  • Welcome Remarks and Lustre 101, Stephen Simms, LUG Program Chair
  • OpenSFS Update, Charlie Carroll, Cray,
  • EOFS Update, Hugo Falter, EOFS
  • Demo: Installing Lustre 2.7 via RPM, Brian Andrus from the ITACS/Research Computing Naval Postgraduate School
  • Lustre Development Update, Christoper Morrone, OpenSFS/LLNL
  • Lustre + Linux – Putting the House in Order, James Simmons,ORNL
  • Cray’s Storage History and Outlook – Lustre+, Jason Goodman, Cray
  • From Lab to Enterprise – Growing the Lustre Ecosystem, Malcolm Cowe, Intel
  • SDSC’s Data Oasis Gen II: ZFS, 40GbE, and Replication, Rick Wagner, San Diego Supercomputer Center
  • There and Back Again – The Battle of Lustre at LANL, Kyle Lamb, Michael Masson, and Susan CoulterLANL
  • Seagate Lustre Update, Peter Bojanic,Seagate Technology
  • Lustre & Kerberos: In Theory and In Practice, Sebastien Buisson, Bull
  • GSS Shared Key Update and Using UID Mapping in Lustre 2.7, Steve Simms, Indiana University
  • ZFS as Backend File System for Lustre: Current Status, How to Optimize, Where to Improve, Gabriele Paciucci Intel
  • Per User Lustre File Systems Leveraging ZFS Pools, Marc Stearman, LLNL
  • Lustre 2.8 and Beyond, Andreas Dilger, Intel
  • Progressive File Layouts, John Hammond, Intel; Jason Hill, ORNL
  • Intelligent Cache Hinting in Lustre, Micah Bhakti, Intel
  • Intel and Lustre: ­ Growth of Lustre Adoption and Intel’s Continued Commitment, Brent Gorda, Intel
  • Lustre HSM in the cloud, Robert Read, Intel
  • Application-optimized Lustre Solutions for Big-Data Workflows, Robert Triendl, DDN
  • Metadata Access Reduction and Analysis and Elimination of Client Evictions on a Large Scale Lustre Based File System, Keiji Yamamoto, RIKEN AICS; Shinji Sumimoto, Fujitsu
  • Lustre Network (LNET) Router Configuration and Tuning, John Fragalla, Seagate Technology
  • Towards continuous 24x7x365 production operation on a router-less 20 petabyte, 11,200 node cluster-or-Defending the Planet with Lustre: Your life could depend on it!, Bob Ciotti, NASA
  • Lustre Metrics: NewTechniques for Monitoring Lustre, Scott Nolin, Andrew Wagner, UW Space Science and Engineering Center
  • New and Improved Lustre Performance Monitoring Tool, Torben Kling Petersen, Seagate Technology
  • Correlating Multiple TB of I/O Performance Data to User Jobs, Michael Kluge, ZIH
  • Monitoring a Heterogeneous Lustre environment, Frédérick Lefebvre, Calcul Quebec Universite Laval
  • Reliability of NVM devices for I/O acceleration on supercomputing systems, Hitoshi Sato, Tokyo Institute of Technology
  • Scalability Testing of DNE2 in Lustre 2.7, Stephen Simms, Indiana University
  • Shared File Performance in Lustre: Challenges and Solutions, Patrick Farrell, Cray
  • OSD-Btrfs, a Novel Lustre OSD based on Btrfs, Shuichi Ihara, Li Xi, DDN
  • Deploying Hadoop on Lustre Storage: Lessons learned and best practices, J.Mario Gallegos, Dell; Zhiqi Tao, Intel
  • Understanding Hadoop Performance on Lustre, Stephen Skory, Seagate Technology