Main Page: Difference between revisions

From Lustre Wiki
Jump to navigation Jump to search
No edit summary
 
(63 intermediate revisions by 9 users not shown)
Line 1: Line 1:
__NOTOC__
__NOTOC__


This is the main community repository for Lustre knowledge and documentation.  Content will grow as we update and bring together information from various sources. Consult the sidebar for links to major Lustre topics. Learn more about Lustre at http://www.lustre.org. Documentation is available at http://lustre.org/documentation.
This site, [http://wiki.lustre.org wiki.lustre.org], is the main community repository for Lustre information. Consult the sidebar for links to major Lustre topics.
 
Learn more about Lustre at http://www.lustre.org.
 
<div style="float:right; width:280px; background: #f5f5f5; border: 1pt solid #ff9900; padding: 10pt; margin: 10pt;">
== Lustre Software Releases ==
 
=== Downloads ===
 
* [https://downloads.whamcloud.com/public/lustre/ Lustre]
* [https://downloads.whamcloud.com/public/e2fsprogs/ Lustre-aware e2fsprogs]
 
=== Current Maintenance Release ===
 
* [[Release_2.12.0 | Lustre 2.12.9]]
** Released [http://lustre.org/lustre-2-12-9-released/ Jun 17, 2022]
** [[Lustre_2.12.7_Changelog | Changelog]]
 
=== Current Major Release ===
 
* [[Release_2.15.0 | Lustre 2.15.4]]
** Released [https://www.lustre.org/lustre-2-15-4-released/ December 22, 2023]
** [[Lustre_2.15.4_Changelog | Changelog]]
 
=== Major Release In Development ===
 
* [[Release_2.16.0 | Lustre 2.16.0]]
** [[Lustre_2.16.0_Changelog | Changelog]]
 
=== Release Roadmap ===
 
* [http://www.lustre.org/roadmap Release Roadmap]
 
=== Previous Releases ===
* See [[Lustre Software Releases]]
</div>
 
== Lustre Enables High Performance, Massively Scalable Storage ==
 
Lustre is an open-source, distributed parallel file system software platform designed for scalability, high-performance, and high-availability.
 
Lustre is purpose-built to provide a coherent, global POSIX-compliant namespace for very large scale computer infrastructure, including the world's largest supercomputer platforms. It can support hundred's of petabytes of data storage and hundreds of gigabytes per second in simultaneous, aggregate throughput. Some of the largest current installations have individual file systems in excess of fifty petabytes of usable capacity, and have reported throughput speeds exceeding one terabyte/sec.
 
== Documentation ==


Note that previous outdated Lustre wiki is currently preserved for posterity at [http://wiki.old.lustre.org wiki.old.lustre.org].
----
=== Introduction to Lustre ===
=== Introduction to Lustre ===
Lustre* is an open-source, global single-namespace, POSIX-compliant, distributed parallel file system designed for scalability, high-performance, and high-availability. Lustre runs on Linux-based operating systems and employs a client-server network architecture. Storage is provided by a set of servers that can scale to populations measuring up to several hundred hosts. Lustre servers for a single file system instance can, in aggregate, present up to tens of petabytes of storage to thousands of compute clients, with more than a terabyte-per-second of combined throughput.


The [[:Category:Lustre_Systems_Administration|Lustre Systems Administration Guide]] describes the various components of Lustre, and provides an overview of how to configure Lustre.
* [[media:LustreArchitecture-v4.pdf | Lustre Architecture (PDF)]]
----
** Learn about core Lustre concepts and architecture
* [[Lustre 101]]
** Introductory "course" on Lustre usage and administration
 
=== Lustre File System Internals ===
*[https://info.ornl.gov/sites/publications/Files/Pub166872.pdf Understanding Lustre Internals, Second Edition]
** Internal workings of Lustre file system and its core subsystems
 
=== Lustre Systems Administration ===
 
* [[:Category:Lustre_Systems_Administration | Lustre Systems Administration Guide]]
** Practical instruction on installation and configuration of production-ready Lustre storage clusters
* [[LNet_Router_Config_Guide | LNet Router Configuration Guide]]
* [[:Category:Benchmarking | Lustre and Storage Benchmarking Guide]]
** Tools to demonstrate the capabilities of the file system and highlight potential defects in the infrastrcuture supporting Lustre
* [[Robinhood_Policy_Engine | Robinhood Policy Engine]]
** Data management platform for large-scale file systems
* [[Integrated_Manager_for_Lustre | Integrated Manager for Lustre]]
** Deployment, management and monitoring platform for Lustre file systems
* [[How_To | HOWTO ]]
** "How to" articles, including how to [[Compiling_Lustre | compile the Lustre software]] from source code
 
=== Lustre Manual ===
 
* The latest Lustre Operations Manual is available for download in several formats:
** [http://doc.lustre.org/lustre_manual.xhtml HTML]
** [http://doc.lustre.org/lustre_manual.pdf PDF]
** [http://doc.lustre.org/lustre_manual.epub ePub]


=== Releases ===
=== Contributing to the Lustre Project ===
===== Current Maintenance Release =====
* Lustre 2.10.1 released [http://lustre.org/lustre-2-10-1-released Oct 3, 2017].
** [http://wiki.lustre.org/Lustre_2.10.1_Changelog Lustre 2.10.1 Changelog]


===== Current Major Release =====
* [[Development|Lustre Development]] overview
* [[Release_2.10.0|Lustre 2.10.0]] released [http://lists.lustre.org/pipermail/lustre-announce-lustre.org/2017/000147.html July 13th, 2017].
* [[Submitting Changes|Contributing code]]
** [http://wiki.lustre.org/Lustre_2.10.0_Changelog Lustre 2.10.0 Changelog]
* [[Lustre Manual Changes|Contributing to the Lustre Manual]]
* [[Projects]]


===== Major Release Under Development =====
== Community ==
* [[Release_2.11.0|Lustre 2.11.0]]
** [http://wiki.lustre.org/Lustre_2.11.0_Changelog Lustre 2.11.0 Changelog]


===== Release Roadmap =====
* Mailing Lists
* [http://www.lustre.org/roadmap Release Roadmap]
** http://lustre.org/mailing-lists/ - (un)subscribe, update
----
** [http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/ lustre-discuss list archive] ([https://marc.info/?l=lustre-discuss alternate])
** [http://lists.lustre.org/pipermail/lustre-devel-lustre.org/ lustre-devel list archive] ([https://marc.info/?l=lustre-devel alternate])
* Community Events World-wide
** http://opensfs.org/events/ - Worldwide Lustre User Group
** https://www.eofs.eu/events/start - European Lustre User Group
** http://lustrefs.cn/ - China Lustre User Group
** https://www.jlug.info/ - Japan Lustre User Group
** https://www.lustrefilesystem.com/ - Lustre User Group UK
** [[Lustre Conferences|Previous Lustre conferences]] with links to presentations and videos
* The [http://opensfs.org/ OpenSFS] organization supports Lustre development.
* The OpenSFS [http://wiki.opensfs.org/LWG Lustre Working Group (LWG)] coordinates OpenSFS's Lustre efforts.
* Whamcloud community wiki
** https://wiki.whamcloud.com/
* Issue tracking and development task management
** https://jira.whamcloud.com/
* Upstream Kernel Slack Workspace
** https://lustreupstreamclient.slack.com/messages/CAV4QF0ER/
** An invitation from the workspace admin is required (James Simmons).


=== [[:Category:Events|Events]] ===
== [[:Category:Events|Events]] ==
==== Upcoming ====
* [http://sc17.supercomputing.org/presentation/?id=bof111&sess=sess323 SC17 Lustre Community BoF] - November 15, 2017 - Denver, Colorado</li>


==== Recent ====
[[Lustre Conferences]] lists past Lustre-related conferences such as LUG, LAD, SC, ISC, JLUG, CLUG, including presentations and videos when available.
* [https://www.eofs.eu/events/lad17 Lustre Admin & Developer Workshop 2017 (LAD’17)] - October 4-5, 2017 - Paris, France
* [https://www.chinalug.info China LUG 2017] - Oct 31, 2017 - Beijing, China
* [http://opensfs.org/lug-2017/ Lustre Users Group 2017 (LUG'17)] - May 30-June 2, 2017 - Bloomington, IN
* [http://sc16.supercomputing.org/presentation/?id=bof194&sess=sess365 SC16 Lustre Community BOF: Lustre Deployments for the Next 5 Years] - November 15, 2016 - Salt Lake City, UT
* [https://www.eofs.eu/events/lad16 Lustre Admin & Developer Workshop 2016 (LAD’16)] - September 20-21, 2016 - Paris, France
* [http://www.pinedalab.org/hpc/disruptive-storage-workshop Disruptive Storage Workshop 2.0] – April 26-27, 2016 – Baltimore, MD
* [http://opensfs.org/events/lug-2016/ Lustre Users Group 2016 (LUG'16)] - April 5-7, 2016 - Portland, OR
* [http://opensfs.org/events/lustre-developer-day/ Lustre Developer Day] - April 4, 2016 - Portland, OR
* [http://lustre.ornl.gov/ecosystem/index.html 2nd International Workshop on The Lustre Ecosystem] - March 8-9, 2016 - Baltimore, MD
* For more prior events, see the [[:Category:Events|Events]] category page
----


=== Get Involved with Lustre Development ===
'''''For a complete list of past events, see the [[:Category:Events|Events]] category page'''''
* The [[Development]] page has links to instructions on how to [[Submitting Changes|contribute code]] and [https://wiki.hpdd.intel.com/display/PUB/Making+changes+to+the+Lustre+Manual update documentation] in Lustre.
* The [http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org lustre-devel] mailing list is the primary forum for discussing Lustre software development.
* The [http://lists.opensfs.org/listinfo.cgi/lwg-opensfs.org Luste Working Group] mailing list will receive notifications for upcoming Luste Working Group meetings.
* The [http://opensfs.org/ OpenSFS] organization supports Lustre development. The OpenSFS [http://wiki.opensfs.org/LWG Lustre Working Group (LWG)] coordinates OpenSFS's Lustre efforts.


=== Lustre.org Infrastructure ===
== Lustre.org Infrastructure ==
See [[Lustre.org Infrastructure]] for information on the lustre.org and opensfs.org websites.
See [[Lustre.org Infrastructure]] for information on the lustre.org and opensfs.org websites.
'''''Note:''''' ''The previous (now outdated) Lustre wiki is currently preserved for posterity at [http://wiki.old.lustre.org wiki.old.lustre.org].''

Latest revision as of 04:57, 2 January 2024


This site, wiki.lustre.org, is the main community repository for Lustre information. Consult the sidebar for links to major Lustre topics.

Learn more about Lustre at http://www.lustre.org.

Lustre Software Releases

Downloads

Current Maintenance Release

Current Major Release

Major Release In Development

Release Roadmap

Previous Releases

Lustre Enables High Performance, Massively Scalable Storage

Lustre is an open-source, distributed parallel file system software platform designed for scalability, high-performance, and high-availability.

Lustre is purpose-built to provide a coherent, global POSIX-compliant namespace for very large scale computer infrastructure, including the world's largest supercomputer platforms. It can support hundred's of petabytes of data storage and hundreds of gigabytes per second in simultaneous, aggregate throughput. Some of the largest current installations have individual file systems in excess of fifty petabytes of usable capacity, and have reported throughput speeds exceeding one terabyte/sec.

Documentation

Introduction to Lustre

Lustre File System Internals

Lustre Systems Administration

Lustre Manual

  • The latest Lustre Operations Manual is available for download in several formats:

Contributing to the Lustre Project

Community

Events

Lustre Conferences lists past Lustre-related conferences such as LUG, LAD, SC, ISC, JLUG, CLUG, including presentations and videos when available.

For a complete list of past events, see the Events category page

Lustre.org Infrastructure

See Lustre.org Infrastructure for information on the lustre.org and opensfs.org websites.

Note: The previous (now outdated) Lustre wiki is currently preserved for posterity at wiki.old.lustre.org.