Data on MDT - Revision history

Adilger: /* Documentation */ add layout category

2018-06-19T07:59:02Z

Documentation: add layout category

← Older revision		Revision as of 00:59, 19 June 2018
Line 23:		Line 23:

	[[Category:Features]]		[[Category:Features]]
			[[Category:Layout]]
	[[Category:DoM]]		[[Category:DoM]]
	[[Category:PFL]]		[[Category:PFL]]

Nrutman at 19:02, 25 August 2017

2017-08-25T19:02:37Z

← Older revision		Revision as of 12:02, 25 August 2017
Line 22:		Line 22:
	* [[Data on MDT High Level Design]]		* [[Data on MDT High Level Design]]

	[[Category:~~Feature~~]]		[[Category:Features]]
	[[Category:DoM]]		[[Category:DoM]]
	[[Category:PFL]]		[[Category:PFL]]

Adilger: /* Documentation */ link to DoM category

2017-07-11T01:15:24Z

Documentation: link to DoM category

← Older revision		Revision as of 18:15, 10 July 2017
Line 23:		Line 23:

	[[Category:Feature]]		[[Category:Feature]]
			[[Category:DoM]]
	[[Category:PFL]]		[[Category:PFL]]

Adilger: /* Documentation */

2017-07-07T17:26:45Z

Documentation

← Older revision		Revision as of 10:26, 7 July 2017
Line 20:		Line 20:
	==Documentation==		==Documentation==
	* [[Data on MDT Solution Architecture]]		* [[Data on MDT Solution Architecture]]
	* [[Data On MDT High Level Design]]		* [[Data on MDT High Level Design]]

	[[Category:Feature]]		[[Category:Feature]]
	[[Category:PFL]]		[[Category:PFL]]

Adilger: /* Documentation */ add Category links

2017-07-07T17:21:01Z

Documentation: add Category links

← Older revision		Revision as of 10:21, 7 July 2017
Line 21:		Line 21:
	* [[Data on MDT Solution Architecture]]		* [[Data on MDT Solution Architecture]]
	* [[Data On MDT High Level Design]]		* [[Data On MDT High Level Design]]

			[[Category:Feature]]
			[[Category:PFL]]

Adilger: initial import from https://wiki.hpdd.intel.com/display/opensfs/Data+On+MDT+Scope+Statement

2017-07-07T17:13:11Z

initial import from https://wiki.hpdd.intel.com/display/opensfs/Data+On+MDT+Scope+Statement

New page

==Feature Goals==

Lustre file system performance is currently optimized for large files. This results in additional RPC round-trips to the OSTs, which hurt small file performance. This project aims to correct this deficiency by allowing the data for small files to be placed on the MDT so that these additional RPCs can be eliminated and performance correspondingly improved. Used in conjunction with DNE, this will preserve efficiency without sacrificing horizontal scale.

Users or system administrators will set a layout policy that locates small files to be stored on an MDT. Files that grow beyond this size will use [[Progressive File Layouts]] to extend larger files onto OST objects and leave the start of the file on the MDT.

==In Scope==

* Implement a new layout for files with data on MDT.
* Client IO stack must allow IO requests to an MDT device.
* Design of a tunable for specifying size limit for files on a MDT.
* Integration of DoM with PFL to automatically extend files from the MDT to OSTs.
* Explicitly allocating small files on the MDT by default directory striping.
* A discussion of interoperability (or lack thereof) of old clients and servers with Data on MDT.

==Out of Scope==

* Automatically locating small files on the MDT after the file has started to be written.

==Documentation==
* [[Data on MDT Solution Architecture]]
* [[Data On MDT High Level Design]]