Installing the Lustre Software - Revision history

GDawes: Update information on patchless installations on Lustre 2.14 and above.

2023-01-25T11:02:15Z

Update information on patchless installations on Lustre 2.14 and above.

← Older revision		Revision as of 03:02, 25 January 2023
Line 61:		Line 61:
	</p>		</p>

	<p>'''Note:''' With ~~the release of~~ Lustre ~~version~~ 2.10.1, it is possible to use patchless kernels for Lustre servers running LDISKFS. The patchless LDISKFS server distribution does not include a Linux kernel. Instead, patchless servers will use the kernel distributed with the operating system. For the time being, the patchless version does not support project quotas - it is expected to do so in the future however. To use patchless kernels for the Lustre servers, replace the string <code>server</code> with <code>patchless-ldiskfs-server</code> at the end of the <code>[lustre-server]</code> <code>baseurl</code> string. For example:		<p>'''Note:''' With Lustre versions 2.10.1 - 2.13.0, it is possible to use patchless kernels for Lustre servers running LDISKFS. The patchless LDISKFS server distribution does not include a Linux kernel. Instead, patchless servers will use the kernel distributed with the operating system. For the time being, the patchless version does not support project quotas - it is expected to do so in the future however. To use patchless kernels for the Lustre servers for these versions, replace the string <code>server</code> with <code>patchless-ldiskfs-server</code> at the end of the <code>[lustre-server]</code> <code>baseurl</code> string. For example:
	</p>		</p>

Line 69:		Line 69:

	<p>'''Note:''' To cut down on the size of the download when testing, uncomment the exclude lines. This will omit the download of the debuginfo packages, which can be large. Nevertheless, it is generally a good idea to pull in these files as well in order that they be readily available to aid debugging.		<p>'''Note:''' To cut down on the size of the download when testing, uncomment the exclude lines. This will omit the download of the debuginfo packages, which can be large. Nevertheless, it is generally a good idea to pull in these files as well in order that they be readily available to aid debugging.
			</p>

			<p>'''Note:''' For Lustre 2.14+, the dkms packages have been rolled into the main repo, thus you can construct a patchless server without needing a different yum/dnf config than the normal one above.
	</p>		</p>
	</li>		</li>

Psuter at 12:23, 29 September 2020

2020-09-29T12:23:23Z

← Older revision		Revision as of 04:23, 29 September 2020
Line 61:		Line 61:
	</p>		</p>

	<p>'''Note:''' With the release of Lustre version 2.10.1, it is possible to use patchless kernels for Lustre servers running LDISKFS. The patchless LDISKFS server distribution does not include a Linux kernel. Instead, patchless servers will use the kernel distributed with the operating system. For the time being, the patchless version does not support project quotas - it is expected to so so in the future however. To use patchless kernels for the Lustre servers, replace the string <code>server</code> with <code>patchless-ldiskfs-server</code> at the end of the <code>[lustre-server]</code> <code>baseurl</code> string. For example:		<p>'''Note:''' With the release of Lustre version 2.10.1, it is possible to use patchless kernels for Lustre servers running LDISKFS. The patchless LDISKFS server distribution does not include a Linux kernel. Instead, patchless servers will use the kernel distributed with the operating system. For the time being, the patchless version does not support project quotas - it is expected to do so in the future however. To use patchless kernels for the Lustre servers, replace the string <code>server</code> with <code>patchless-ldiskfs-server</code> at the end of the <code>[lustre-server]</code> <code>baseurl</code> string. For example:
	</p>		</p>

Psuter at 12:22, 29 September 2020

2020-09-29T12:22:44Z

← Older revision		Revision as of 04:22, 29 September 2020
Line 61:		Line 61:
	</p>		</p>

	<p>'''Note:''' With the release of Lustre version 2.10.1, it is possible to use patchless kernels for Lustre servers running LDISKFS. The patchless LDISKFS server distribution does not include a Linux kernel. Instead, patchless servers will use the kernel distributed with the operating system. To use patchless kernels for the Lustre servers, replace the string <code>server</code> with <code>patchless-ldiskfs-server</code> at the end of the <code>[lustre-server]</code> <code>baseurl</code> string. For example:		<p>'''Note:''' With the release of Lustre version 2.10.1, it is possible to use patchless kernels for Lustre servers running LDISKFS. The patchless LDISKFS server distribution does not include a Linux kernel. Instead, patchless servers will use the kernel distributed with the operating system. For the time being, the patchless version does not support project quotas - it is expected to so so in the future however. To use patchless kernels for the Lustre servers, replace the string <code>server</code> with <code>patchless-ldiskfs-server</code> at the end of the <code>[lustre-server]</code> <code>baseurl</code> string. For example:
	</p>		</p>

Adilger: fix links

2018-06-22T17:58:08Z

fix links

← Older revision		Revision as of 09:58, 22 June 2018
Line 5:		Line 5:
	For more comprehensive coverage of third party network driver support, refer to the [[Compiling Lustre]] article, which will show how to create these packages. Once created, the process for installing these customised packages is very similar to the process described here.		For more comprehensive coverage of third party network driver support, refer to the [[Compiling Lustre]] article, which will show how to create these packages. Once created, the process for installing these customised packages is very similar to the process described here.

	'''Note:''' it is recommended that the host operating system is always installed with the latest kernel release supported by the operating system vendor. This ensures that the kernel is protected against known security vulnerabilities and has the latest bug fixes. The Lustre developers work to ensure that Lustre remains compatible across operating system kernel updates for supported platforms. For the latest information on compatibility for Linux kernels, refer to the Lustre [https://git.~~hpdd.intel~~.com/?p=fs/lustre-release.git;a=blob;f=lustre/ChangeLog ChangeLog] file.		'''Note:''' it is recommended that the host operating system is always installed with the latest kernel release supported by the operating system vendor. This ensures that the kernel is protected against known security vulnerabilities and has the latest bug fixes. The Lustre developers work to ensure that Lustre remains compatible across operating system kernel updates for supported platforms. For the latest information on compatibility for Linux kernels, refer to the Lustre [https://git.whamcloud.com/?p=fs/lustre-release.git;a=blob;f=lustre/ChangeLog ChangeLog] file.

	== Lustre and OpenZFS ==		== Lustre and OpenZFS ==
Line 40:		Line 40:
	[lustre-server]		[lustre-server]
	name=lustre-server		name=lustre-server
	baseurl=https://downloads.~~hpdd.intel~~.com/public/lustre/latest-release/el7/server		baseurl=https://downloads.whamcloud.com/public/lustre/latest-release/el7/server
	# exclude=debuginfo		# exclude=debuginfo
	gpgcheck=0		gpgcheck=0
Line 46:		Line 46:
	[lustre-client]		[lustre-client]
	name=lustre-client		name=lustre-client
	baseurl=https://downloads.~~hpdd.intel~~.com/public/lustre/latest-release/el7/client		baseurl=https://downloads.whamcloud.com/public/lustre/latest-release/el7/client
	# exclude=debuginfo		# exclude=debuginfo
	gpgcheck=0		gpgcheck=0
Line 52:		Line 52:
	[e2fsprogs-wc]		[e2fsprogs-wc]
	name=e2fsprogs-wc		name=e2fsprogs-wc
	baseurl=https://downloads.~~hpdd.intel~~.com/public/e2fsprogs/latest/el7		baseurl=https://downloads.whamcloud.com/public/e2fsprogs/latest/el7
	# exclude=debuginfo		# exclude=debuginfo
	gpgcheck=0		gpgcheck=0
Line 65:		Line 65:

	<pre style="overflow-x:auto;">		<pre style="overflow-x:auto;">
	baseurl=https://downloads.~~hpdd.intel~~.com/public/lustre/latest-release/el7/patchless-ldiskfs-server		baseurl=https://downloads.whamcloud.com/public/lustre/latest-release/el7/patchless-ldiskfs-server
	</pre>		</pre>

Line 300:		Line 300:
	</pre>		</pre>

	<p>Refer to the Lustre [https://git.~~hpdd.intel~~.com/?p=fs/lustre-release.git;a=blob;f=lustre/ChangeLog ChangeLog] for the list of supported kernels.		<p>Refer to the Lustre [https://git.whamcloud.com/?p=fs/lustre-release.git;a=blob;f=lustre/ChangeLog ChangeLog] for the list of supported kernels.
	</p>		</p>
	</li>		</li>
Line 440:		Line 440:
	</pre>		</pre>

	<p>Refer to the Lustre [https://git.~~hpdd.intel~~.com/?p=fs/lustre-release.git;a=blob;f=lustre/ChangeLog ChangeLog] for the list of supported kernels.		<p>Refer to the Lustre [https://git.whamcloud.com/?p=fs/lustre-release.git;a=blob;f=lustre/ChangeLog ChangeLog] for the list of supported kernels.
	</p>		</p>
	</li>		</li>

Malcolm: /* Using DKMS */

2017-11-09T04:29:25Z

Using DKMS

← Older revision		Revision as of 20:29, 8 November 2017
Line 140:		Line 140:
	There is a cost for this automatic maintenance: since DKMS compiles the kernel modules from source code, the software development toolchain must also be installed on each machine that will use DKMS. In addition, Lustre's <code>configure</code> script makes decisions during execution about what optional features of Lustre to enable, based on the development packages that have been installed. If a full suite of optional features is required, then the development libraries for those features must be included in the OS payload.		There is a cost for this automatic maintenance: since DKMS compiles the kernel modules from source code, the software development toolchain must also be installed on each machine that will use DKMS. In addition, Lustre's <code>configure</code> script makes decisions during execution about what optional features of Lustre to enable, based on the development packages that have been installed. If a full suite of optional features is required, then the development libraries for those features must be included in the OS payload.

	The following command will install the additional packages that are required to facilitate DKMS-based installations:		The following command will install the additional packages that are required to facilitate DKMS-based installations. These packages must be installed on every machine that will use DKMS to install the Lustre software:

	<pre style="overflow-x:auto;">		<pre style="overflow-x:auto;">
Line 156:		Line 156:
	</pre>		</pre>

	'''Note:''' ~~'''''~~ Refer to [[Compiling Lustre#Development Software Installation for Normal Build Process\|Establishing a Build Environment]] in the [[Compiling Lustre]] article for a comprehensive set of packages to install when compiling Lustre from source.~~'''''~~		'''Note:''' Additional packages may be added as dependencies of those listed above. Refer to [[Compiling Lustre#Development Software Installation for Normal Build Process\|Establishing a Build Environment]] in the [[Compiling Lustre]] article for a comprehensive set of packages to install when compiling Lustre from source.

	== Lustre Server Software Installation ==		== Lustre Server Software Installation ==

Malcolm at 04:25, 9 November 2017

2017-11-09T04:25:50Z

Show changes

Malcolm: /* Using DKMS */

2017-11-08T23:10:39Z

Using DKMS

@@ Line 133: / Line 133: @@
 There is a cost for this automatic maintenance: since DKMS compiles the kernel modules from source code, the software development toolchain must also be installed on each machine that will use DKMS. In addition, Lustre's <code>configure</code> script makes decisions during execution about what optional features of Lustre to enable, based on the development packages that have been installed. If a full suite of optional features is required, then the development libraries for those features must be included in the OS payload.
-'''Note:''' '''''In order to keep the content concise, the DKMS examples in this document will install the essential configuration only. Refer to [[Compiling Lustre#Development Software Installation for Normal Build Process|Establishing a Build Environment]] in the [[Compiling Lustre]] article for a comprehensive set of packages to install when compiling Lustre from source.'''''
+The following additional packages will be required to facilitate DKMS-based installations:
 == Lustre Server Software Installation ==

Malcolm: /* Using YUM to Manage Local Software Provisioning */

2017-10-10T21:18:01Z

Using YUM to Manage Local Software Provisioning

← Older revision		Revision as of 13:18, 10 October 2017
Line 31:		Line 31:
	The following instructions can be used to help establish a web server as a YUM repository host for the Lustre packages. The examples make use of the default directory structure for an Apache HTTP server on RHEL / CentOS 7. NGINX and other web servers may use different directory structures to store content.		The following instructions can be used to help establish a web server as a YUM repository host for the Lustre packages. The examples make use of the default directory structure for an Apache HTTP server on RHEL / CentOS 7. NGINX and other web servers may use different directory structures to store content.

	'''Note:''' The installation processes used in this article assume that there is a YUM repo definition for the Lustre packages configured on the machines where Lustre will be installed.		'''Note:''' The installation processes used in this article assume that there is a YUM repo definition for the Lustre packages configured on the machines where Lustre will be installed. To install Lustre software packages without using YUM, use the below process to download the packages, then copy the packages to each Lustre machine. Use the command <code>yum localinstall <rpm package> [...]</code> to install the downloaded packages instead of the regular <code>yum</code> commands. When using the <code>yum localinstall</code> command, the full file name for each package is required.

	<ol>		<ol>

Malcolm at 06:09, 6 September 2017

2017-09-06T06:09:18Z

← Older revision		Revision as of 22:09, 5 September 2017
Line 68:		Line 68:

	<pre style="overflow-x:auto;">		<pre style="overflow-x:auto;">
	mkdir -p /var~~/lib~~/www/html/repo		mkdir -p /var/www/html/repo
	cd /var/www/html/repo		cd /var/www/html/repo
	reposync -c /tmp/lustre-repo.conf -n \		reposync -c /tmp/lustre-repo.conf -n \

Malcolm at 05:46, 31 August 2017

2017-08-31T05:46:37Z

← Older revision		Revision as of 21:46, 30 August 2017
Line 465:		Line 465:

	[[Category:Lustre Software Installation]]		[[Category:Lustre Software Installation]]
			[[Category:Lustre Systems Administration]]