Lustre User Group 2017: Difference between revisions

From Lustre Wiki
Jump to navigation Jump to search
(adding video links)
 
(7 intermediate revisions by the same user not shown)
Line 46: Line 46:
|-
|-
|'''1:20pm'''
|'''1:20pm'''
|'''''[[Media:Wed07-KaitschuckJohn-PaF_LUG2017v2.pdf|The effects of fragmentation and capacity on Lustre Filesystem performance]]''''' [ (video)]
|'''''[[Media:Wed07-KaitschuckJohn-PaF_LUG2017v2.pdf|The effects of fragmentation and capacity on Lustre Filesystem performance]]''''' [https://youtu.be/-9hh4k1JhGg (video)]
: John Kaitschuck, Seagate CSSG
: John Kaitschuck, Seagate CSSG
|-
|-
|'''1:50pm'''
|'''1:50pm'''
|'''''[[Media:LUG_2017-new2.pdf|Providing QoS-mechanisms for Lustre through centralized control applying the TBF-NRS]]''''' [ (video)]
|'''''[[Media:LUG_2017-new2.pdf|Providing QoS-mechanisms for Lustre through centralized control applying the TBF-NRS]]''''' [https://youtu.be/5n9ZwT1L7SE (video)]
: André Brinkmann, Johannes Gutenberg University Mainz; Jürgen Kaiser, Johannes Gutenberg University Mainz; Li Xi, DDN; Lingfang Zeng, Johannes Gutenberg University Mainz; Qian Yingjin, DDN; Shuichi Ihara, DDN; Tim Süß, Johannes Gutenberg University Mainz
: André Brinkmann, Johannes Gutenberg University Mainz; Jürgen Kaiser, Johannes Gutenberg University Mainz; Li Xi, DDN; Lingfang Zeng, Johannes Gutenberg University Mainz; Qian Yingjin, DDN; Shuichi Ihara, DDN; Tim Süß, Johannes Gutenberg University Mainz
|-
|-
|'''2:20pm'''
|'''2:20pm'''
|'''''[[Media:Wed09-HussainArshad-LUG_2017_Online_Patching_of_Lustre_v1.pdf|Lustre Filesystem - Online patching]]''''' [ (video)]
|'''''[[Media:Wed09-HussainArshad-LUG_2017_Online_Patching_of_Lustre_v1.pdf|Lustre Filesystem - Online patching]]''''' [https://youtu.be/0NfMGIVW1ZI (video)]
: Andriy Skulysh, Seagate; Arshad Hussain, Seagate
: Andriy Skulysh, Seagate; Arshad Hussain, Seagate
|-
|-
|'''2:50pm'''
|'''2:50pm'''
|'''''[[Media:Wed10-EreminDmitry-LUG2017-Client%20IO%20Parallelization-Dmitry-FINAL.pdf|Client IO parallelization]]''''' [ (video)]
|'''''[[Media:Wed10-EreminDmitry-LUG2017-Client%20IO%20Parallelization-Dmitry-FINAL.pdf|Client IO parallelization]]''''' [https://youtu.be/qSTXufVsIiA (video)]
: Dmitry Eremin, Senior Software Engineer, Intel
: Dmitry Eremin, Senior Software Engineer, Intel
|-
|-
Line 66: Line 66:
|-
|-
|'''3:40pm'''
|'''3:40pm'''
|'''''[[Media:Wed11-GoriniStefano-LUG2017_20170601.pdf|CSCS site update]]''''' [ (video)]
|'''''[[Media:Wed11-GoriniStefano-LUG2017_20170601.pdf|CSCS site update]]''''' [https://youtu.be/_80SebHbhtY (video)]
: Carmelo Ponti, CSCS; Matteo Chesi, CSCS; Stefano Gorini, CSCS
: Carmelo Ponti, CSCS; Matteo Chesi, CSCS; Stefano Gorini, CSCS
|-
|-
|'''4:10pm'''
|'''4:10pm'''
|'''''[[Media:Wed12-SlavinShawn-Agro-IBIS%20LUG%202017.pdf|Scaling parallel modeling of agroecosystems with Lustre]]''''' [ (video)]
|'''''[[Media:Wed12-SlavinShawn-Agro-IBIS%20LUG%202017.pdf|Scaling parallel modeling of agroecosystems with Lustre]]''''' [https://youtu.be/GQmboflvo5o (video)]
: H.E. Cicada Dennis, Indiana University Pervasive Technology Institute; Robert Henschel, Indiana University Pervasive Technology Institute; Shawn Slavin, Indiana University Pervasive Technology Institute; Stephen Simms, Indiana University Pervasive Technology Institute; Tyler Balson, Indiana University Pervasive Technology Institute; Adam Ward, Indiana University Pervasive Technology Institute; Yuwei Li, Indiana University Pervasive Technology Institute
: H.E. Cicada Dennis, Indiana University Pervasive Technology Institute; Robert Henschel, Indiana University Pervasive Technology Institute; Shawn Slavin, Indiana University Pervasive Technology Institute; Stephen Simms, Indiana University Pervasive Technology Institute; Tyler Balson, Indiana University Pervasive Technology Institute; Adam Ward, Indiana University Pervasive Technology Institute; Yuwei Li, Indiana University Pervasive Technology Institute
|-
|-
|'''4:40pm'''
|'''4:40pm'''
|'''''[[Media:Lug_2017_harms_mcpheeters.pdf|Intel Enterprise Edition 3.0 for Lustre on Sonexion 3000]]''''' [ (video)]
|'''''[[Media:Lug_2017_harms_mcpheeters.pdf|Intel Enterprise Edition 3.0 for Lustre on Sonexion 3000]]''''' [https://youtu.be/fw4SxEllP0g (video)]
: Ben Allen, Argonne National Laboratory; Gordon McPheeters, Argonne National Laboratory; Kevin Harms, Argonne National Laboratory; Mark Fahey, Argonne National Laboratory
: Ben Allen, Argonne National Laboratory; Gordon McPheeters, Argonne National Laboratory; Kevin Harms, Argonne National Laboratory; Mark Fahey, Argonne National Laboratory
|-
|-
|'''5:10pm'''
|'''5:10pm'''
|'''''[[Media:Wed14-IharaShuichi-LUG2017-OpenStack-0531ver2.pdf|OpenStack Cinder drive for Lustre]]''''' [ (video)]
|'''''[[Media:Wed14-IharaShuichi-LUG2017-OpenStack-0531ver2.pdf|OpenStack Cinder drive for Lustre]]''''' [https://youtu.be/Wi1de7deYls (video)]
: Shuichi Ihara, DDN; Wang Shilong, DDN
: Shuichi Ihara, DDN; Wang Shilong, DDN
|-
|-
Line 95: Line 95:
|-
|-
|'''9:00am'''
|'''9:00am'''
|'''LUG17 Day 2 Opening remarks''' [ (video)]
|'''LUG17 Day 2 Opening remarks'''
: Stephen Simms, Indiana University
: Stephen Simms, Indiana University
|-
|-
|'''9:10am'''
|'''9:10am'''
|'''''[[Media:Thur01-TriendlRobert-Growing-up%20with%20Lustre.pdf|Growing-up with Lustre]]''''' [ (video)]
|'''''[[Media:Thur01-TriendlRobert-Growing-up%20with%20Lustre.pdf|Growing-up with Lustre]]''''' [https://youtu.be/OA0s4uL_FVo (video)]
: Robert Triendl, DDN
: Robert Triendl, DDN
|-
|-
|'''9:30am'''
|'''9:30am'''
|'''''[[Media:Thur02-OpenSFS%20Annual%20Members%20Meeting_2017_v5.pdf|OpenSFS Board Elections]]''''' [ (video)]
|'''''[[Media:Thur02-OpenSFS%20Annual%20Members%20Meeting_2017_v5.pdf|OpenSFS Board Elections]]''''' [https://youtu.be/jw4Jn1iCffc (video)]
:  
:  
|-
|-
Line 111: Line 111:
|-
|-
|'''10:50am'''
|'''10:50am'''
|'''''[[Media:Thur03-ShehataAmir-LUG2017-LNet%20Health-Amir.%20FINAL.pdf|LNet network health]]''''' [ (video)]
|'''''[[Media:Thur03-ShehataAmir-LUG2017-LNet%20Health-Amir.%20FINAL.pdf|LNet network health]]''''' [https://youtu.be/TKLy-w5Z9po (video)]
: Amir Shehata, Intel
: Amir Shehata, Intel
|-
|-
|'''11:20am'''
|'''11:20am'''
|'''''[[Media:Thur04-SimmonsJames-Lustre_Tracing.pdf|How to use perf/tracepoint with Lustre]]''''' [ (video)]
|'''''[[Media:Thur04-SimmonsJames-Lustre_Tracing.pdf|How to use perf/tracepoint with Lustre]]''''' [https://youtu.be/kOabXLbqYEQ (video)]
: James Simmons, ORNL
: James Simmons, ORNL
|-
|-
|'''11:50am'''
|'''11:50am'''
|'''''[[Media:Thur05-DilgerAndreas-LUG2017-Lustre%202.11%20and%20Beyond-FINAL.pdf|Lustre 2.11 and beyond]]'''''
|'''''[[Media:Thur05-DilgerAndreas-LUG2017-Lustre%202.11%20and%20Beyond-FINAL.pdf|Lustre 2.11 and beyond]]''''' [https://youtu.be/-9Pm7SkfK7c (video)]
: Andreas Dilger, Principal Lustre Architect, Intel Corporation
: Andreas Dilger, Principal Lustre Architect, Intel Corporation
|-
|-
Line 127: Line 127:
|-
|-
|'''1:30pm'''
|'''1:30pm'''
|'''''[[Media:Thur06-MohrRichard-LUG17-Slides-v3.pdf|Lustre management with Ansible]]''''' [ (video)]
|'''''[[Media:Thur06-MohrRichard-LUG17-Slides-v3.pdf|Lustre management with Ansible]]''''' [https://youtu.be/WX00LQLYf2w (video)]
: Christopher Layton, Oak Ridge National Laboratory; Nathan Grodowitz, HPC Admin, Oak Ridge National Labs; Rick Mohr, Senior HPC System Administrator, National Institute for Computational Sciences
: Christopher Layton, Oak Ridge National Laboratory; Nathan Grodowitz, HPC Admin, Oak Ridge National Labs; Rick Mohr, Senior HPC System Administrator, National Institute for Computational Sciences
|-
|-
|'''2:00pm'''
|'''2:00pm'''
|'''''[[Media:Morrone_LUG2017.pdf|Scalable high availability for Lustre with Pacemaker]]''''' [ (video)]
|'''''[[Media:Morrone_LUG2017.pdf|Scalable high availability for Lustre with Pacemaker]]''''' [https://youtu.be/bv1mNVTL7I0 (video)]
: Christopher Morrone, Computer Scientist, Lawrence Livermore National Laboratory
: Christopher Morrone, Computer Scientist, Lawrence Livermore National Laboratory
|-
|-
|'''2:30pm'''
|'''2:30pm'''
|'''''[[Media:Thur08-XiLi-Policy_Engine_LUG_LiXI_0.5.pdf|Lustre integrated policy engine]]''''' [ (video)]
|'''''[[Media:Thur08-XiLi-Policy_Engine_LUG_LiXI_0.5.pdf|Lustre integrated policy engine]]''''' [https://youtu.be/m07i-AhcNPw (video)]
: Li Xi, DDN
: Li Xi, DDN
|-
|-
Line 143: Line 143:
|-
|-
|'''3:20pm'''
|'''3:20pm'''
|'''''[[Media:Thur09-DoreauHenri-rbh_v3_lug2017.pdf|Take back control with Robinhood v3]]''''' [ (video)]
|'''''[[Media:Thur09-DoreauHenri-rbh_v3_lug2017.pdf|Take back control with Robinhood v3]]''''' [https://youtu.be/sEWh06CJLYk (video)]
: Henri Doreau, CEA
: Henri Doreau, CEA
|-
|-
|'''3:50pm'''
|'''3:50pm'''
|'''''[[Media:Thur9.5-FaberColin-%28LUG%29%20Seagate%20Robinhood%20Optimizations%20%286%29.pdf|Improving overall Robinhood performance for use on large scale deployments]]''''' [ (video)]
|'''''[[Media:Thur9.5-FaberColin-%28LUG%29%20Seagate%20Robinhood%20Optimizations%20%286%29.pdf|Improving overall Robinhood performance for use on large scale deployments]]''''' [https://youtu.be/31AHfzSXPr0  (video)]
: Colin Faber, Sr. Staff Engineer, Seagate
: Colin Faber, Sr. Staff Engineer, Seagate
|-
|-
|'''4:20pm'''
|'''4:20pm'''
|'''''[[Media:Thur10-Raso-Barnett-Hammond-LUG2017.pdf|An extensible and scalable Lustre HSM Agent and Data Movers]]''''' [ (video)]
|'''''[[Media:Thur10-Raso-Barnett-Hammond-LUG2017.pdf|An extensible and scalable Lustre HSM Agent and Data Movers]]''''' [https://youtu.be/bdKC7z7PAmc (video)]
: John Hammond, Software Engineer, Intel Corporation; Matt Rásó-Barnett, Cambridge University; Wojciech Turek, Cambridge University
: John Hammond, Software Engineer, Intel Corporation; Matt Rásó-Barnett, Cambridge University; Wojciech Turek, Cambridge University
|-
|-
|'''4:50pm'''
|'''4:50pm'''
|'''''[[Media:Thur11-LanjewarUjjwal-LUG%202017-%20Lustre%20HSM%20for%20HPC%20-%20High%20Speed%20Distributed%20Data%20Mover%20-%20r1.10.pdf|High speed distributed data mover for Lustre HSM]]''''' [ (video)]
 
: Bikrant Singh, Seagate Technology; Ujjwal Lanjewar, Architect, Seagate Technology
|'''''[[Media:LUG_2017-_Lustre_HSM_for_HPC_-_High_Speed_Distributed_Data_Mover_-_r1.11.pdf|High speed distributed data mover for Lustre HSM]]''''' [https://youtu.be/Xje4pQMx-0I (video)]
: Ujjwal Lanjewar, Architect, Seagate Technology; Bikrant Singh, Seagate Technology; Ajay Nair, Seagate Technology; Bhagyesh Dudhediya, Seagate Technology  
|-
|-
|style="background:#E0E0E0"|'''5:30pm'''
|style="background:#E0E0E0"|'''5:30pm'''
Line 171: Line 172:
   
   
|}
|}
=== Friday, June 2 ===
=== Friday, June 2 ===
{| border=1 cellpadding=0
{| border=1 cellpadding=0
Line 179: Line 181:
|-
|-
|'''9:00am'''
|'''9:00am'''
|'''LUG17 Day 3 Opening remarks''' [ (video)]
|'''LUG17 Day 3 Opening remarks'''
: Stephen Simms, Indiana University
: Stephen Simms, Indiana University
|-
|-
|'''9:10am'''
|'''9:10am'''
|'''''[[Media:Fri01-JuddJosh-LUG%202017.pdf|Managing self-encrypting HDDs with Lustre/ZFS]]''''' [ (video)]
|'''''[[Media:Fri01-JuddJosh-LUG%202017.pdf|Managing self-encrypting HDDs with Lustre/ZFS]]''''' [https://youtu.be/KrvXR0VJm0Y (video)]
: Josh Judd, WARP Mechanics
: Josh Judd, WARP Mechanics
|-
|-
|'''9:30am'''
|'''9:30am'''
|'''''[[Media:Fri02-NunezJames-LUG2017-Applicaton_IO_Profiling_with_lustre-FINAL.pdf|Profiling application IO patterns with Lustre]]''''' [ (video)]
|'''''[[Media:Fri02-NunezJames-LUG2017-Applicaton_IO_Profiling_with_lustre-FINAL.pdf|Profiling application IO patterns with Lustre]]''''' [https://youtu.be/XEtzHQjiJI4 (video)]
: James Nunez, Intel Corporation; Gabriele Paciucci, Intel; Zhiqi Tao, Intel
: James Nunez, Intel Corporation; Gabriele Paciucci, Intel; Zhiqi Tao, Intel
|-
|-
|'''10:00am'''
|'''10:00am'''
|'''''[[Media:Fri03-BrunstHolger-2017-06-02_LUG17_IO_Performance_NEXTGenIO_Tools_Brunst_Bloomington-v2.pdf|Analyzing I/O performance on a NEXTGenIO class system]]''''' [ (video)]
|'''''[[Media:Fri03-BrunstHolger-2017-06-02_LUG17_IO_Performance_NEXTGenIO_Tools_Brunst_Bloomington-v2.pdf|Analyzing I/O performance on a NEXTGenIO class system]]''''' [https://youtu.be/Y2Pv2VjoOBY (video)]
: Christian Herold, TU Dresden; Holger Brunst, TU Dresden
: Christian Herold, TU Dresden; Holger Brunst, TU Dresden
|-
|-
Line 199: Line 201:
|-
|-
|'''10:50am'''
|'''10:50am'''
|'''''[[Media:bent_lug17.pdf|Unraveling "Burst Buffer" tiers: A survey of the various instantiations]]''''' [ (video)]
|'''''[[Media:bent_lug17.pdf|Unraveling "Burst Buffer" tiers: A survey of the various instantiations]]''''' [https://youtu.be/zq4Cpe6PlHc (video)]
: John Bent, Seagate Government Solutions; Meghan McClelland, Seagate
: John Bent, Seagate Government Solutions; Meghan McClelland, Seagate
|-
|-
|'''11:20am'''
|'''11:20am'''
|'''''[[Media:Fri05-WagnerRick-LUG2017-Wagner-Chard-v2.pdf|Responsive storage]]''''' [ (video)]
|'''''[[Media:Fri05-WagnerRick-LUG2017-Wagner-Chard-v2.pdf|Responsive storage]]''''' [https://youtu.be/fg5s0LrCiTk (video)]
: Rick Wagner, Globus; Ryan Chard, Argonne National Laboratory
: Rick Wagner, Globus; Ryan Chard, Argonne National Laboratory
|-
|-

Latest revision as of 09:08, 10 July 2017

LUG 2017 was held in Bloomington, Indiana from May 31st-June 2nd, 2017. Additionally, Lustre Developer Day 2017 was held on May 30th, 2017.

LUG 2017 Agenda

Wednesday, May 31

7:30am Breakfast
9:00am LUG17 Day 1 Opening remarks (video)
Stephen Simms, Indiana University
9:10am Intel Lustre Update (video)
Bryon Neitzel, Intel
9:30am Community release update (video)
Peter Jones, Intel
10:00am Status of the Lustre upstream client (video)
James Simmons, ORNL
10:30am Break
10:50am Scaling LDISKFS for the future. Again. (video)
Artem Blagodarenko, Seagate; Alexey Lyashkov, Seagate
11:20am Roads to Zester (video)
Kenrick Rawlings, Indiana University Pervasive Technology Institute; Shawn Slavin, Indiana University Pervasive Technology Institute
11:50am OST data migration using ZFS snapshots/send/receive (video)
Tom Crowe, Indiana University Pervasive Technology Institute
12:20pm Lunch
1:20pm The effects of fragmentation and capacity on Lustre Filesystem performance (video)
John Kaitschuck, Seagate CSSG
1:50pm Providing QoS-mechanisms for Lustre through centralized control applying the TBF-NRS (video)
André Brinkmann, Johannes Gutenberg University Mainz; Jürgen Kaiser, Johannes Gutenberg University Mainz; Li Xi, DDN; Lingfang Zeng, Johannes Gutenberg University Mainz; Qian Yingjin, DDN; Shuichi Ihara, DDN; Tim Süß, Johannes Gutenberg University Mainz
2:20pm Lustre Filesystem - Online patching (video)
Andriy Skulysh, Seagate; Arshad Hussain, Seagate
2:50pm Client IO parallelization (video)
Dmitry Eremin, Senior Software Engineer, Intel
3:20pm Break
3:40pm CSCS site update (video)
Carmelo Ponti, CSCS; Matteo Chesi, CSCS; Stefano Gorini, CSCS
4:10pm Scaling parallel modeling of agroecosystems with Lustre (video)
H.E. Cicada Dennis, Indiana University Pervasive Technology Institute; Robert Henschel, Indiana University Pervasive Technology Institute; Shawn Slavin, Indiana University Pervasive Technology Institute; Stephen Simms, Indiana University Pervasive Technology Institute; Tyler Balson, Indiana University Pervasive Technology Institute; Adam Ward, Indiana University Pervasive Technology Institute; Yuwei Li, Indiana University Pervasive Technology Institute
4:40pm Intel Enterprise Edition 3.0 for Lustre on Sonexion 3000 (video)
Ben Allen, Argonne National Laboratory; Gordon McPheeters, Argonne National Laboratory; Kevin Harms, Argonne National Laboratory; Mark Fahey, Argonne National Laboratory
5:10pm OpenStack Cinder drive for Lustre (video)
Shuichi Ihara, DDN; Wang Shilong, DDN
6:00pm Dinner and a Movie - sponsored by Intel

Thursday, June 1

7:30am Breakfast
9:00am LUG17 Day 2 Opening remarks
Stephen Simms, Indiana University
9:10am Growing-up with Lustre (video)
Robert Triendl, DDN
9:30am OpenSFS Board Elections (video)
10:30am Break
10:50am LNet network health (video)
Amir Shehata, Intel
11:20am How to use perf/tracepoint with Lustre (video)
James Simmons, ORNL
11:50am Lustre 2.11 and beyond (video)
Andreas Dilger, Principal Lustre Architect, Intel Corporation
12:20pm Lunch
1:30pm Lustre management with Ansible (video)
Christopher Layton, Oak Ridge National Laboratory; Nathan Grodowitz, HPC Admin, Oak Ridge National Labs; Rick Mohr, Senior HPC System Administrator, National Institute for Computational Sciences
2:00pm Scalable high availability for Lustre with Pacemaker (video)
Christopher Morrone, Computer Scientist, Lawrence Livermore National Laboratory
2:30pm Lustre integrated policy engine (video)
Li Xi, DDN
3:00pm Break
3:20pm Take back control with Robinhood v3 (video)
Henri Doreau, CEA
3:50pm Improving overall Robinhood performance for use on large scale deployments (video)
Colin Faber, Sr. Staff Engineer, Seagate
4:20pm An extensible and scalable Lustre HSM Agent and Data Movers (video)
John Hammond, Software Engineer, Intel Corporation; Matt Rásó-Barnett, Cambridge University; Wojciech Turek, Cambridge University
4:50pm High speed distributed data mover for Lustre HSM (video)
Ujjwal Lanjewar, Architect, Seagate Technology; Bikrant Singh, Seagate Technology; Ajay Nair, Seagate Technology; Bhagyesh Dudhediya, Seagate Technology
5:30pm Transportation to/from Conference Center (IMU)
7:45pm Transportation to/from Pub Crawl
8:00pm Pub Crawl - sponsored by HGST+WARP

Friday, June 2

7:30am Breakfast
9:00am LUG17 Day 3 Opening remarks
Stephen Simms, Indiana University
9:10am Managing self-encrypting HDDs with Lustre/ZFS (video)
Josh Judd, WARP Mechanics
9:30am Profiling application IO patterns with Lustre (video)
James Nunez, Intel Corporation; Gabriele Paciucci, Intel; Zhiqi Tao, Intel
10:00am Analyzing I/O performance on a NEXTGenIO class system (video)
Christian Herold, TU Dresden; Holger Brunst, TU Dresden
10:30am Break
10:50am Unraveling "Burst Buffer" tiers: A survey of the various instantiations (video)
John Bent, Seagate Government Solutions; Meghan McClelland, Seagate
11:20am Responsive storage (video)
Rick Wagner, Globus; Ryan Chard, Argonne National Laboratory
11:50am LUG17 Closing Remarks
12:00pm Lunch
Retrieved from "http://wiki.lustre.org/index.php?title=Lustre_User_Group_2017&oldid=2529"