[LUDOC-536] Lustre Wiki: Review Old/Obscure Tool or System Integration Pages

• Type: Improvement
• Resolution: Unresolved
• Priority: Minor
• Labels: dwg
• Severity: 3
• Assignee: Cyrus Ramavarapu
• Reporter: Ellis Wilson

Description

The following pages are all over 3 years old.  These are being reviewed as part of the efforts of the Lustre Documentation Working Group.  The main intent of this bug is to evaluate if these pages require:

• Reorganization
• Removal due to staleness
• Extension due to missing material
• Correction to fix incorrect or stale material

The author is expected to annotate this work item with the changes expected.  They may or may not make those changes as part of this work item.  If they choose to not make those changes, they are expected to create a new work item where the identified, explicit improvements can be made by another individual within the LUDOC stream.  If they do choose to make those changes, please clarify such in the comment section.

The full list of pages include:

Old/Obscure Tool or System Integration Pages:

[PCircle|https://wiki.lustre.org/PCircle]‏‎ (13:58, 7 April 2016)

[Shine|https://wiki.lustre.org/Shine]‏‎ (12:20, 11 May 2016)

[Collectl|https://wiki.lustre.org/Collectl]‏‎ (12:34, 11 May 2016)

[Running Hadoop with Lustre | https://wiki.lustre.org/Running_Hadoop_with_Lustre]‏‎ (07:26, 2 June 2016)

[Check MK/Graphite/Graphios Setup Guide|https://wiki.lustre.org/Check_MK/Graphite/Graphios_Setup_Guide]‏‎ (18:08, 20 May 2016) (probably overly specific/stale)

[Using Red Hat Cluster Manager with Lustre|https://wiki.lustre.org/Using_Red_Hat_Cluster_Manager_with_Lustre]‏‎ (07:54, 15 June 2016)

[Using Xen with Lustre|https://wiki.lustre.org/Using_Xen_with_Lustre]‏‎ (08:29, 10 August 2016)

[MDT Mirroring with ZFS and SRP|https://wiki.lustre.org/MDT_Mirroring_with_ZFS_and_SRP]‏‎ (17:41, 14 December 2016)

[Create a Virtual HPC Storage Cluster with Vagrant|https://wiki.lustre.org/Create_a_Virtual_HPC_Storage_Cluster_with_Vagrant]‏‎ (02:11, 18 May 2017)

[KVM Quick Start Guide|https://wiki.lustre.org/KVM_Quick_Start_Guide]‏‎ (15:47, 13 November 2020)

Comments

[Cyrus Ramavarapu]

Examined links on the virtualization pages:

Xen With Lustre * Virtualization Guide from Centos is 404 – remove

• Mounting Xen Guest Images goes elsewhere. Remove link and just include Xen beginners guide
• Xen Virtualization Essentials is from virtuapedia which is between 8 and 16 years old. Remove this link.
• Xen project link is still good
• Xen Community mailing list link is a 404. Replace with: [Join mailing lists | Xen Project|https://xenproject.org/resources/mailing-lists/]
• Installing and Using Zen - server unreachable. Replace with: Getting Started - Xen
• There is nothing Lustre Specific on this article, but the virtualization help might be good for some. Rename Page.

KVM Quick Start Guide * isodirect links for centos7 are broken

• centos mirror links are broken
• whamcloud links are broken
• Consider updating instructions for Rocky 8?

 
Create a Virtual HPC Storage Cluster with Vagrant

•  Downloading the random vagrantfile.gz from the wiki seems risky

 

Planned Reorganization of the Virtualization pages:

Virtualization Topic with Xen, KVM, and Vagrant sections. Both KVM and Vagrant have instructions on how to install Lustre on them. Xen is missing this information and it currently unclear if the server can be stood up on Xen although there are ~10 year old blog posts discussing that point [see references]. Expanding this page to include details on how to get at least the client running on Xen would be good.

 

[Cyrus Ramavarapu]

• Updated pages for shine and collectl

[Cyrus Ramavarapu]

Update:

• Collectl
    * Add link to github repository with recent commits [Collectl|sharkcz/collectl: git mirror of collectl releases (github.com)]
    * Move to a section on general monitoring tools
    * Consider removal if there is insufficient interest or if this tool has been sufficiently superseded by dstat
• MDT Mirroring with ZFS and SRP
    * Follow suggestion to replace SRP with NVMeOF
• Shine
    * Fix or remove broken link to LAD 2012 slides
    * Github is still active and author is making commits
• KVM Quick Start Guide, Using Xen with Lustre, Deploying with Vagrant
    * Virtualization is important, and these articles would benefit from more recent information
    * Consider reorganizing under a Virtualization and Lustre category

Move:

• Hadoop with Lustre
    * The work is interesting but more of a research project than a tool
    * Consider moving the information or adding links to the appropriate conference pages

Remove (or put into a legacy tool category):

• PCircle
    * No recent development in the last 6 years and looks incomplete on GitHub. Based on Python2 / Rhel7.
• Graphios Setup Guide
    * Too Specific and links are not present on the SSES site at UofWisc
    * The Graphite project is still alive and might be relevant to general Lustre monitoring tools. [Graphite](https://github.com/graphite-project/graphite-web/tree/master)
• Using Red Hat Cluster Manager with Lustre
    * Project is not supported after RHEL7 and the documentation is based on RHEL5

[Andreas Dilger]

"MDT Mirroring with ZFS and SRP" -> this could be made relevant again if "SRP" was replaced with steps to use NVMe-over-fabrics.