Lustre.org Wiki Migration
Jump to navigation
Jump to search
Guidelines
wiki.hpdd.intel.com supersedes wiki.old.lustre.org
Maintenance on the wiki at wiki.old.lustre.org ended a few years ago. While that remained stagnant, the wiki at wiki.hpdd.intel.com took its place. When ever there is similar information in both places, use the information from the HPDD wiki rather than the wiki.old wiki.
New wiki pages should not have "Lustre" in the title.
The entire wiki is about Lustre. The page titles double as the URL, and we want to keep both clean and concise. Instead of:
http://wiki.lustre.org/Lustre_Publications
we would want the less redundant and more concise:
http://wiki.lustre.org/Publications
The exception to this rule is when the word "Lustre" is part of a larger formal name, such as in "Lustre User Group" or "Lustre.org".
Statuses
| Status | Description |
|---|---|
| to-move | can be moved to the new wiki (merged if there is an existing new page) without update |
| to-update-and-move | needs updating before move, but no domain-specific knowledge necessary |
| to-review | reviewer with domain-specific knowledge needed |
| to-delete | page will not be moved and will no longer be available when the old wiki is shut down |
| moved | moved to the new wiki |
| updated-and-moved | updated and moved to new wiki |
Categories
- All pages moved to the new wiki must have a category assigned (to facilitate discovery from the lustre.org front-page when categories surfaced)
Notes
- Add a note for any status change
- Add initials after all notes except purely informational data (e.g. has-redirect, has-files, redirect-page)
- Surround notes with square brackets to demarcate the note
For example: [status-change: to-delete -KR]
wiki.old.lustre.org Pages
| Page | Status | Category | Notes | |
|---|---|---|---|---|
| Acceptance Small (acc-sm) Testing on Lustre | to-review | [has-files: 1] [status-change: to-review -KR] | ||
| Accessing Lustre Code | to-delete | [status-change: to-delete -CM] [out of date -CM] | ||
| Applying Lustre Patches to a Kernel | to-review | [status-change: to-review -KR] | ||
| Architecture - Adaptive Timeouts - Use Cases | to-review | [status-change: to-review -KR] [we likely want to preserve the Architecture_* articles on some level, there's quite a bit of useful information in them that's worth reviewing and moving. Perhaps merge them into Architecture Descriptions? -KR] | ||
| Architecture - Backup | to-review | [status-change: to-review -KR] | ||
| Architecture - CROW | to-review | [status-change: to-review -KR] | ||
| Architecture - CTDB with Lustre | to-review | [status-change: to-review -KR] | ||
| Architecture - Caching OSS | to-review | [status-change: to-review -KR] | ||
| Architecture - Changelogs | to-review | [status-change: to-review -KR] | ||
| Architecture - Changelogs 1.6 | to-review | [status-change: to-review -KR] | ||
| Architecture - Client Cleanup | to-review | [status-change: to-review -KR] | ||
| Architecture - Clustered Metadata | to-review | [status-change: to-review -KR] | ||
| Architecture - Commit on Share | to-review | [status-change: to-review -KR] | ||
| Architecture - Cuts | to-review | [has-files: 2] [status-change: to-review -KR] | ||
| Architecture - DMU OSD | to-review | [status-change: to-review -KR] | ||
| Architecture - DMU Zerocopy | to-review | [status-change: to-review -KR] | ||
| Architecture - End-to-end Checksumming | to-review | [status-change: to-review -KR] | ||
| Architecture - Epochs | to-review | [status-change: to-review -KR] | ||
| Architecture - External File Locking | to-review | [status-change: to-review -KR] | ||
| Architecture - FIDs on OST | to-review | [status-change: to-review -KR] | ||
| Architecture - Feature FS Replication | to-review | [status-change: to-review -KR] | ||
| Architecture - Fileset | to-review | [status-change: to-review -KR] | ||
| Architecture - Flash Cache | to-review | [status-change: to-review -KR] | ||
| Architecture - Free Space Management | to-review | [status-change: to-review -KR] | ||
| Architecture - GNS | to-review | [status-change: to-review -KR] | ||
| Architecture - HSM | to-review | [status-change: to-review -KR] | ||
| Architecture - HSM Migration | to-review | [status-change: to-review -KR] | ||
| Architecture - HSM and Cache | to-review | [status-change: to-review -KR] | ||
| Architecture - IO system | to-review | [status-change: to-review -KR] | ||
| Architecture - Interoperability 1.6 1.8 2.0 | to-review | [status-change: to-review -KR] | ||
| Architecture - Interoperability fids zfs | to-review | [status-change: to-review -KR] | ||
| Architecture - LRE Images | to-review | [status-change: to-review -KR] | ||
| Architecture - Libcfs | to-review | [status-change: to-review -KR] | ||
| Architecture - Llog over OSD | to-review | [status-change: to-review -KR] | ||
| Architecture - Lustre DLDs | to-review | [has-files: 57] [status-change: to-review -KR] | ||
| Architecture - Lustre HLDs | to-review | [has-files: 107] [status-change: to-review -KR] | ||
| Architecture - Lustre Logging API | to-review | [status-change: to-review -KR] | ||
| Architecture - MDS-on-DMU | to-review | [status-change: to-review -KR] | ||
| Architecture - MDS striping format | to-review | [has-files: 1] [status-change: to-review -KR] | ||
| Architecture - MPI IO and NetCDF | to-review | [status-change: to-review -KR] | ||
| Architecture - MPI LND | to-review | [has-files: 1] [status-change: to-review -KR] | ||
| Architecture - Metadata API | to-review | [status-change: to-review -KR] | ||
| Architecture - Migration (1) | to-review | [status-change: to-review -KR] | ||
| Architecture - Migration (2) | to-review | [status-change: to-review -KR] | ||
| Architecture - Multiple Interfaces For LNET | to-review | [status-change: to-review -KR] | ||
| Architecture - Network Request Scheduler | to-review | [status-change: to-review -KR] | ||
| Architecture - New Metadata API | to-review | [status-change: to-review -KR] | ||
| Architecture - OSS-on-DMU | to-review | [status-change: to-review -KR] | ||
| Architecture - Open by fid | to-review | [status-change: to-review -KR] | ||
| Architecture - PAG | to-review | [status-change: to-review -KR] | ||
| Architecture - Pools of targets | to-review | [status-change: to-review -KR] | ||
| Architecture - Profiling Tools for IO | to-review | [status-change: to-review -KR] | ||
| Architecture - Proxy Cache | to-review | [status-change: to-review -KR] | ||
| Architecture - Punch and Extent Migration | to-review | [status-change: to-review -KR] | ||
| Architecture - Punch and Extent Migration Requirements | to-review | [status-change: to-review -KR] | ||
| Architecture - Recovery Failures | to-review | [status-change: to-review -KR] | ||
| Architecture - Request Redirection | to-review | [status-change: to-review -KR] | ||
| Architecture - Scalable Pinger | to-review | [status-change: to-review -KR] | ||
| Architecture - Security | to-review | [status-change: to-review -KR] | ||
| Architecture - Server Network Striping | to-review | [status-change: to-review -KR] | ||
| Architecture - Simple Space Balance Migration | to-review | [status-change: to-review -KR] | ||
| Architecture - Simplified Interoperation | to-review | [status-change: to-review -KR] | ||
| Architecture - Space Manager | to-review | [status-change: to-review -KR] | ||
| Architecture - Sub Tree Locks | to-review | [status-change: to-review -KR] | ||
| Architecture - User Level Access | to-review | [status-change: to-review -KR] | ||
| Architecture - User Level OSS | to-review | [status-change: to-review -KR] | ||
| Architecture - Userspace Servers | to-review | [status-change: to-review -KR] | ||
| Architecture - Version Based Recovery | to-review | [status-change: to-review -KR] | ||
| Architecture - Wide Striping | to-review | [status-change: to-review -KR] | ||
| Architecture - Wire Level Protocol | to-review | [status-change: to-review -KR] | ||
| Architecture - Write Back Cache | to-review | [status-change: to-review -KR] | ||
| Architecture - Writing Architecture Documents | to-review | [status-change: to-review -KR] | ||
| Architecture - ZFS TinyZAP | to-review | [status-change: to-review -KR] | ||
| Architecture - ZFS for Lustre | to-review | [status-change: to-review -KR] | ||
| Architecture - ZFS large dnodes | to-review | [status-change: to-review -KR] | ||
| Architecture Descriptions | to-review | [status-change: to-review -KR] | ||
| Backing Up a Lustre File System | to-update-and-move | [status-change: to-update-and-move -KR] | ||
| Building Lustre Code | to-update-and-move | [status-change: to-update-and-move -KR] [definitely needs updating, but shouldn't require too much deep domain knowledge -KR] | ||
| Building and Installing Lustre from Source Code | to-update-and-move | [status-change: to-update-and-move -KR] [similar situation to "Building Lustre Code", also worth considering merge with that article -KR] | ||
| Change Log 1.6 | to-move | [status-change: to-move -KR] | ||
| Change Log 1.8 | to-move | [status-change: to-move -KR] | ||
| Change Log 2.0 | to-move | [has-files: 1] [status-change: to-move -KR] | ||
| Clustered Metadata | [has-files: 1] [previous failed DNE attempt. to-delete or keep for posterity? -CM] | |||
| Coding Guidelines | to-delete | [status-change: to-delete -CM] [We already have Lustre_Coding_Guidelines -CM] | ||
| Completing Basic Administrative Tasks | to-delete | [status-change: to-delete -CM] [odd random chapter index for old manual -CM] | ||
| Configuring InfiniBand Connectivity | to-delete | [status-change: to-delete -CM] [too out of date and too specific -CM] | ||
| Configuring Lustre File Striping | to-update-and-move | [status-change: to-update-and-move -KR] [minor updates needed, also worth adding references to useful guides like the NICS Lustre Striping Guide -KR ] | ||
| Configuring Lustre for Failover | to-update-and-move | [status-change: to-update-and-move -KR] | ||
| Configuring RAID for Disk Arrays | to-review | [status-change: to-review -KR] | ||
| Configuring the Lustre File System | to-update-and-move | [status-change: to-update-and-move -KR] [likely merge with Lustre Configuration Example -KR] | ||
| Contribute | to-delete | [redirect-page] [status-change: to-delete -KR] | ||
| Contribute:Contribute | ||||
| Contribution Policy | to-delete | [status-change: to-delete -CM] [out of date, see HPDD wiki -CM] | ||
| Creating and Managing OST Pools | ||||
| DRBD and Lustre | ||||
| Debian Install | ||||
| Debugging Lustre | ||||
| Developers Guide to Bugzilla for Lustre | to-delete | [status-change: to-delete -CM] | ||
| Diagnostic and Debugging Tools | ||||
| Documenting Code | ||||
| Download | to-delete | [redirect-page] [status-change: to-delete -KR] | ||
| Download:Download | ||||
| E1000 Driver Tuning | to-delete | [status-change: to-delete -CM] | ||
| FAQ - Fundamentals | to-review | [status-change:to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - Glossary | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - Installation | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - Licensing and Support | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - Metadata Servers | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - Networking | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - OS Support | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - Object Servers and I/O Throughput | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - Recovery | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - Release Testing and Upgrading | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| FAQ - Sizing | to-review | [status-change: to-review -KR] [review and incorporate still-relevant info into new wiki Frequently Asked Questions -KR] | ||
| Finding a Project | [needs overhaul if kept -CM] | |||
| Fsck Support | to-delete | [redirect-page] [status-change: to-delete -KR] | ||
| GSS / Kerberos | ||||
| GetInvolved:Get Involved | [has-files: 4] | |||
| Get Involved | to-delete | [redirect-page] [status-change: to-delete -KR] | ||
| Git Transition Notice | to-delete | [status-change: to-delete -CM] [ancient history -CM] | ||
| Guidelines for Setting Up a Cluster | to-delete | [status-change: to-delete -CM] [Not lustre specific. There are better guides out there. -CM] | ||
| HPC Software Workshop and Seminars - Regensburg Germany 2009 | to-move | [has-files: 17] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Handling File System Errors | ||||
| Handling Full OSTs | ||||
| Installing Lustre from Downloaded RPMs | ||||
| Large-Scale Tuning for Cray XT | ||||
| Learn | to-delete | [redirect-page] [status-change: to-delete -KR] | ||
| Learn:Learn | ||||
| LibLustre How-To Guide | to-delete | [status-change: to-delete -CM] [liblustre is dead -CM] | ||
| Load Balancing with Infiniband | ||||
| Logging API | ||||
| Lustre 1.8 | to-move | [has-files: 10] [rename on move to "Release 1.8" -KR] | ||
| Lustre 2.0 to-update-and-move | [has-files: 1] [rename to "Release 2.0" and merge with Lustre 2.0 Features -KR] | |||
| Lustre 2.0 Features | to-delete | [merge with Lustre 2.0 -KR] | ||
| Lustre 2.0 Release Milestone Status | to-delete | [has-files: 23] [status-change: to-delete -KR] [there doesn't seem to be useful information here going forward unless we want to preserve this for posterity but has little current value -KR] | ||
| Lustre All-Hands Meeting 12/08 | to-move | [has-files: 14] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Lustre All-Hands Meeting 3/08 | to-move | [has-files: 10] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Lustre Center of Excellence at Oak Ridge National Laboratory | to-move | [has-files: 23] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Lustre Community Events, Conferences and Meetings | ||||
| Lustre Configuration Example | [status-change: to-update-and-move -KR] [likely merge with Configuring the Lustre File System -KR] | |||
| Lustre Customers | [has-files: 3] | |||
| Lustre DDN Tuning | ||||
| Lustre Debugging Procedures | ||||
| Lustre Debugging for Developers | ||||
| Lustre Design Document Archive | [has-files: 17] | |||
| Lustre Design Documents | ||||
| Lustre Documentation | [has-files: 4] | |||
| Lustre FAQ | to-delete | [status-change: to-delete -CM] [Incorporate still-relevant info from the old FAQ's sub-pages into the new one-page Frequently Asked Questions -CM] | ||
| Lustre FUSE | to-delete | [status-change: to-delete -CM] [liblustre is dead -CM] | ||
| Lustre Fall Workshop 10/2010 | [has-files: 3] | |||
| Lustre Features | to-delete | [redirect-page] [status-change: to-delete -CM] | ||
| Lustre HPCS Activities | [has-files: 10] | |||
| Lustre Internals | [has-files: 3] | |||
| Lustre Interoperability - Upgrading From 1.8 to 2.0 | ||||
| Lustre Mailing Lists | to-delete | [status-change: to-delete -CM] [we already have this -CM] | ||
| Lustre Packages | to-delete | [status-change: to-delete -CM] [out of date, easy to make a better guide in the future without this -CM] | ||
| Lustre Project List | to-delete | [status-change: to-delete -CM] [ancient, we have Projects instead -CM] | ||
| Lustre Projects | to-delete | [status-change: to-delete -CM] [summary page no longer relevant -CM] | ||
| Lustre Publications | [has-files: 21] | |||
| Lustre Release Information | ||||
| Lustre Support | to-delete | [status-change: to-delete -CM] [mostly an Ad for Xyratex, mailing list references already available elsewhere -CM] | ||
| Lustre Support Matrix | to-delete | [redirect-page] [status-change: to-delete -KR] | ||
| Lustre System Configuration Utilities | ||||
| Lustre Test Plans | [has-files: 9] [this seems like a good candidate for to-delete unless we want to preserve it for posterity for some reason] | |||
| Lustre Tuning | ||||
| Lustre User Group 2006 | to-move | [has-files: 10] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Lustre User Group 2007 | to-move | [has-files: 13] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Lustre User Group 2008 | to-move | [has-files: 22] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Lustre User Group 2009 | to-move | [has-files: 25] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Lustre User Group 2010 | to-move | [has-files: 26] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Lustre User Group 2011 | to-delete | [status-change: to-delete -KR] | ||
| Lustre User Group 2012 | to-delete | [status-change: to-delete -KR] | ||
| Lustre User Group 2014 | to-delete | [status-change: to-delete -KR] | ||
| Main Page | to-delete | [status-change: to-delete -CM] | ||
| Managing Free Space | ||||
| Managing Lustre Failover | ||||
| Managing OSTs | ||||
| Metadata Performance Project | [has-files: 1] [another page that like Clustered Metadata might be worth keeping for posterity -KR] | |||
| Migrating to Git | to-delete | [status-change: to-delete -CM] | ||
| NFS vs. Lustre | ||||
| Netconsole | to-delete | [status-change: to-delete -CM] [out of date, not lustre specific so unlikely to ever be kept up to date -CM] | ||
| POSIX Compliance Testing | ||||
| Patchless Client | ||||
| Preparing to Install Lustre | [has-files: 1] | |||
| RAID5 Patches | ||||
| Recovering from a Node or Network Failure | ||||
| Reporting Bugs | ||||
| Running Hadoop with Lustre | to-update-and-move | [has-files: 1] [status-change: to-update-and-move] [pretty light on content, but seems worth moving especially if added references to some of the more recent presentations on Hadoop on Lustre (e.g. [1] [2]) | ||
| SC'09 and Lustre Senior Technical Meeting 11/09 | to-move | [has-files: 17] [status-change: to-move -KR] [Assigned to Ken as part of file transfer work -KR] | ||
| Sample Style | to-delete | [status-change: to-delete -CM] | ||
| Setting up Lustre Security | ||||
| Simul Parallel File System Test Tool | ||||
| Submitting Patches | to-delete | [has-files: 1] [status-change: to-delete -CM] [all wrong, start over from scratch or copy from HPDD wiki -CM] | ||
| Subsystem Map | [has-files: 1] | |||
| Testing Lustre Code | ||||
| Tuning Lustre for Performance | ||||
| Upgrading to a New Version of Lustre | ||||
| Use | to-delete | [redirect-page] [status-change: to-delete -KR] | ||
| Use:Change Log 1.8 | to-delete | [redirect-page] [status-change: to-delete -KR] | ||
| Use:Use | ||||
| Using Pacemaker with Lustre | ||||
| Using Quotas | ||||
| Using Red Hat Cluster Manager with Lustre | ||||
| Using Xen with Lustre | ||||
| Windows Native Client | to-review | [status-change: to-review -KR] [is this still an active project? I couldn't find any repositories/product-pages or any references to it since the 2013 LAD Presentation -KR] | ||
| Working with File System Labels | ||||
| ZFS Resources | ||||
| ZFS and Lustre |
wiki.hpdd.intel.com Pages
Andreas has already translated and copied some pages from the HPDD wiki, but no doubt there are many more pages remaining.
LID
We should remember to make a copy of the LID (Lustre Internals Document) sources for posterity. We don't necessarily need to keep it on a web page, but we could at least put the sources in a git repo on github.