Lustre File System: Demo Quick Start Guide 
by Torben Kling-Petersen
March 2009
The Lustre™ file system is a scalable, secure, robust, and highly-available cluster file system that addresses the I/O needs, such as low latency and extreme performance, of large computing clusters. Designed, developed, and maintained by Sun Microsystems, the Lustre file system is intended for environments where traditional shared file systems, such as NFS, do not scale to the required aggregate throughput or large number of nodes.
While the Lustre file system has been around for a number of years in the Open Source arena and there are a large number of installations worldwide, getting started without reading a 500+ page manual - and having to be a Linux expert as well - is difficult. This paper provides a simple cookbook for non-Linux experts on how to set up a Linux-based Lustre file system using small servers, workstations, PCs, or other available hardware for demonstration purposes.
Contents
- Lustre file system overview
- Configuration overview
- Preliminary setup
- Installing the Linux operating system
- Creating the virtual volumes
- Installing the Lustre stack
- Lustre file system configuration
- Metadata Server
- Object Store Servers
- Client
- Managing the file system
- Using stripes
- Handling full OSTs
- Migrating data within a file system
- Summary
- About the author
- References
- Ordering Sun documents
- Accessing Sun documentation online
Torben Kling-Petersen has worked with high performance computing in one form or another since 1994 and is currently working as a Senior Technical Specialist for HPC in Sun's Lustre Group. Over the years, he has worked in a number of capacities such as lead architect for enterprise datacenter infrastructure, technical research lead and product specialist for high-end visualization, to mention a few. In his present capacity, Torben works in a global role providing technical evangelism and solution architectures on petaflop-scale HPC projects.
| Rate this blueprint (Log In to vote.) | |
|---|---|
| Choices | Your Vote |
Great |
|
Good |
|
Fair |
|
Poor |
|
Comments (3)
Jul 17
lustre_tester says:
Excellent guide! Thank you much! But there is a small mistake: 7.Login as root...Excellent guide!
Thank you much!
But there is a small mistake:
7.Login as root to the MDS, and repeat Steps 1 to 5 to create a single logical volume (MDT) for the MDS. As each file written to the Lustre file system requires 4 KB of storage space in the MDS, a 1 GB logical volume for the MDT is more than sufficient for most typical deployments.
I think you should add this line:
"lvcreate --name vg00/mdt --size 1000M"
And change "logical volume" to "virtual volume" for more clear
Sep 21
ngrkic says:
Did you build one volume or six?Was confused building it....Did you build one volume or six?Was confused building it....
Sep 21
ngrkic says:
I was confused too...And i have one question.Does we need to build one or six ...I was confused too...And i have one question.Does we need to build one or six volumes for MDS?