Lustre.org Wiki Migration

Guidelines

wiki.hpdd.intel.com supersedes wiki.old.lustre.org

Maintenance on the wiki at wiki.old.lustre.org ended a few years ago. While that remained stagnant, the wiki at wiki.hpdd.intel.com took its place. When ever there is similar information in both places, use the information from the HPDD wiki rather than the wiki.old wiki.

New wiki pages should not have "Lustre" in the title.

The entire wiki is about Lustre. The page titles double as the URL, and we want to keep both clean and concise. Instead of:

http://wiki.lustre.org/Lustre_Publications

we would want the less redundant and more concise:

http://wiki.lustre.org/Publications

The exception to this rule is when the word "Lustre" is part of a larger formal name, such as in "Lustre User Group" or "Lustre.org".

Statuses

Status	Description
to-move	can be moved to the new wiki (merged if there is an existing new page) without update
to-update-and-move	needs updating before move, but no domain-specific knowledge necessary
to-review	reviewer with domain-specific knowledge needed
to-delete	page will not be moved and will no longer be available when the old wiki is shut down
moved	moved to the new wiki
updated-and-moved	updated and moved to new wiki

Notes

• Add a note for any status change
• Add initials after all notes except purely informational data (e.g. has-redirect, has-files, redirect-page)
• Surround notes with square brackets to demarcate the note

For example: [status-change: to-delete -KR]

wiki.old.lustre.org Pages

Page	Status	Category	Notes
Acceptance Small (acc-sm) Testing on Lustre			[has-files: 1]
Accessing Lustre Code	to-delete		[status-change: to-delete -CM] [out of date -CM]
Applying Lustre Patches to a Kernel
Architecture - Adaptive Timeouts - Use Cases
Architecture - Backup
Architecture - CROW
Architecture - CTDB with Lustre
Architecture - Caching OSS
Architecture - Changelogs
Architecture - Changelogs 1.6
Architecture - Client Cleanup
Architecture - Clustered Metadata
Architecture - Commit on Share
Architecture - Cuts			[has-files: 2]
Architecture - DMU OSD
Architecture - DMU Zerocopy
Architecture - End-to-end Checksumming
Architecture - Epochs
Architecture - External File Locking
Architecture - FIDs on OST
Architecture - Feature FS Replication
Architecture - Fileset
Architecture - Flash Cache
Architecture - Free Space Management
Architecture - GNS
Architecture - HSM
Architecture - HSM Migration
Architecture - HSM and Cache
Architecture - IO system
Architecture - Interoperability 1.6 1.8 2.0
Architecture - Interoperability fids zfs
Architecture - LRE Images
Architecture - Libcfs
Architecture - Llog over OSD
Architecture - Lustre DLDs			[has-files: 57]
Architecture - Lustre HLDs			[has-files: 107]
Architecture - Lustre Logging API
Architecture - MDS-on-DMU
Architecture - MDS striping format			[has-files: 1]
Architecture - MPI IO and NetCDF
Architecture - MPI LND			[has-files: 1]
Architecture - Metadata API
Architecture - Migration (1)
Architecture - Migration (2)
Architecture - Multiple Interfaces For LNET
Architecture - Network Request Scheduler
Architecture - New Metadata API
Architecture - OSS-on-DMU
Architecture - Open by fid
Architecture - PAG
Architecture - Pools of targets
Architecture - Profiling Tools for IO
Architecture - Proxy Cache
Architecture - Punch and Extent Migration
Architecture - Punch and Extent Migration Requirements
Architecture - Recovery Failures
Architecture - Request Redirection
Architecture - Scalable Pinger
Architecture - Security
Architecture - Server Network Striping
Architecture - Simple Space Balance Migration
Architecture - Simplified Interoperation
Architecture - Space Manager
Architecture - Sub Tree Locks
Architecture - User Level Access
Architecture - User Level OSS
Architecture - Userspace Servers
Architecture - Version Based Recovery
Architecture - Wide Striping
Architecture - Wire Level Protocol
Architecture - Write Back Cache
Architecture - Writing Architecture Documents
Architecture - ZFS TinyZAP
Architecture - ZFS for Lustre
Architecture - ZFS large dnodes
Architecture Descriptions
Backing Up a Lustre File System
Building Lustre Code
Building and Installing Lustre from Source Code
Change Log 1.6
Change Log 1.8
Change Log 2.0			[has-files: 1]
Clustered Metadata			[has-files: 1] [previous failed DNE attempt. to-delete or keep for posterity? -CM]
Coding Guidelines	to-delete		[status-change: to-delete -CM] [We already have Lustre_Coding_Guidelines -CM]
Completing Basic Administrative Tasks	to-delete		[status-change: to-delete -CM] [odd random chapter index for old manual -CM]
Configuring InfiniBand Connectivity	to-delete		[status-change: to-delete -CM] [too out of date and too specific -CM]
Configuring Lustre File Striping
Configuring Lustre for Failover
Configuring RAID for Disk Arrays
Configuring the Lustre File System
Contribute	to-delete		[redirect-page] [status-change: to-delete -KR]
Contribute:Contribute
Contribution Policy	to-delete		[status-change: to-delete -CM] [out of date, see HPDD wiki -CM]
Creating and Managing OST Pools
DRBD and Lustre
Debian Install
Debugging Lustre
Developers Guide to Bugzilla for Lustre	to-delete		[status-change: to-delete -CM]
Diagnostic and Debugging Tools
Documenting Code
Download	to-delete		[redirect-page] [status-change: to-delete -KR]
Download:Download
E1000 Driver Tuning	to-delete		[status-change: to-delete -CM]
FAQ - Fundamentals
FAQ - Glossary
FAQ - Installation
FAQ - Licensing and Support
FAQ - Metadata Servers
FAQ - Networking
FAQ - OS Support
FAQ - Object Servers and I/O Throughput
FAQ - Recovery
FAQ - Release Testing and Upgrading
FAQ - Sizing
Finding a Project			[needs overhaul if kept -CM]
Fsck Support	to-delete		[redirect-page] [status-change: to-delete -KR]
GSS / Kerberos
GetInvolved:Get Involved			[has-files: 4]
Get Involved	to-delete		[redirect-page] [status-change: to-delete -KR]
Git Transition Notice	to-delete		[status-change: to-delete -CM] [ancient history -CM]
Guidelines for Setting Up a Cluster	to-delete		[status-change: to-delete -CM] [Not lustre specific. There are better guides out there. -CM]
HPC Software Workshop and Seminars - Regensburg Germany 2009			[has-files: 17]
Handling File System Errors
Handling Full OSTs
Installing Lustre from Downloaded RPMs
Large-Scale Tuning for Cray XT
Learn	to-delete		[redirect-page] [status-change: to-delete -KR]
Learn:Learn
LibLustre How-To Guide	to-delete		[status-change: to-delete -CM] [liblustre is dead -CM]
Load Balancing with Infiniband
Logging API
Lustre 1.8			[has-files: 10]
Lustre 2.0			[has-files: 1]
Lustre 2.0 Features
Lustre 2.0 Release Milestone Status			[has-files: 23]
Lustre All-Hands Meeting 12/08			[has-files: 14]
Lustre All-Hands Meeting 3/08			[has-files: 10]
Lustre Center of Excellence at Oak Ridge National Laboratory			[has-files: 23]
Lustre Community Events, Conferences and Meetings
Lustre Configuration Example
Lustre Customers			[has-files: 3]
Lustre DDN Tuning
Lustre Debugging Procedures
Lustre Debugging for Developers
Lustre Design Document Archive			[has-files: 17]
Lustre Design Documents
Lustre Documentation			[has-files: 4]
Lustre FAQ	to-delete		[status-change: to-delete -CM] [Incorporate still-relevant info from the old FAQ's sub-pages into the new one-page Frequently Asked Questions -CM]
Lustre FUSE	to-delete		[status-change: to-delete -CM] [liblustre is dead -CM]
Lustre Fall Workshop 10/2010			[has-files: 3]
Lustre Features	to-delete		[redirect-page] [status-change: to-delete -CM]
Lustre HPCS Activities			[has-files: 10]
Lustre Internals			[has-files: 3]
Lustre Interoperability - Upgrading From 1.8 to 2.0
Lustre Mailing Lists	to-delete		[status-change: to-delete -CM] [we already have this -CM]
Lustre Packages	to-delete		[status-change: to-delete -CM] [out of date, easy to make a better guide in the future without this -CM]
Lustre Project List	to-delete		[status-change: to-delete -CM] [ancient, we have Projects instead -CM]
Lustre Projects	to-delete		[status-change: to-delete -CM] [summary page no longer relevant -CM]
Lustre Publications			[has-files: 21]
Lustre Release Information
Lustre Support	to-delete		[status-change: to-delete -CM] [mostly an Ad for Xyratex, mailing list references already available elsewhere -CM]
Lustre Support Matrix	to-delete		[redirect-page] [status-change: to-delete -KR]
Lustre System Configuration Utilities
Lustre Test Plans			[has-files: 9]
Lustre Tuning
Lustre User Group 2006	to-move		[has-files: 10] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR]
Lustre User Group 2007	to-move		[has-files: 13] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR]
Lustre User Group 2008	to-move		[has-files: 22] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR]
Lustre User Group 2009	to-move		[has-files: 25] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR]
Lustre User Group 2010	to-move		[has-files: 26] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR]
Lustre User Group 2011	to-delete		[status-change: to-delete -KR]
Lustre User Group 2012	to-delete		[status-change: to-delete -KR]
Lustre User Group 2014	to-delete		[status-change: to-delete -KR]
Main Page	to-delete		[status-change: to-delete -CM]
Managing Free Space
Managing Lustre Failover
Managing OSTs
Metadata Performance Project			[has-files: 1]
Migrating to Git	to-delete		[status-change: to-delete -CM]
NFS vs. Lustre
Netconsole	to-delete		[status-change: to-delete -CM] [out of date, not lustre specific so unlikely to ever be kept up to date -CM]
POSIX Compliance Testing
Patchless Client
Preparing to Install Lustre			[has-files: 1]
RAID5 Patches
Recovering from a Node or Network Failure
Reporting Bugs
Running Hadoop with Lustre			[has-files: 1]
SC'09 and Lustre Senior Technical Meeting 11/09			[has-files: 17]
Sample Style	to-delete		[status-change: to-delete -CM]
Setting up Lustre Security
Simul Parallel File System Test Tool
Submitting Patches	to-delete		[has-files: 1] [status-change: to-delete -CM] [all wrong, start over from scratch or copy from HPDD wiki -CM]
Subsystem Map			[has-files: 1]
Testing Lustre Code
Tuning Lustre for Performance
Upgrading to a New Version of Lustre
Use	to-delete		[redirect-page] [status-change: to-delete -KR]
Use:Change Log 1.8	to-delete		[redirect-page] [status-change: to-delete -KR]
Use:Use
Using Pacemaker with Lustre
Using Quotas
Using Red Hat Cluster Manager with Lustre
Using Xen with Lustre
Windows Native Client
Working with File System Labels
ZFS Resources
ZFS and Lustre

wiki.hpdd.intel.com Pages

Andreas has already translated and copied some pages from the HPDD wiki, but no doubt there are many more pages remaining.

LID

We should remember to make a copy of the LID (Lustre Internals Document) sources for posterity. We don't necessarily need to keep it on a web page, but we could at least put the sources in a git repo on github.