[LU-12231] parallel-scale-nfsv4 test racer_on_nfs fails with 'test_racer_on_nfs failed with 1'

• Type: Bug
• Resolution: Duplicate
• Priority: Minor
• Affects Version/s: Lustre 2.13.0, Lustre 2.12.1, Lustre 2.12.3, Lustre 2.12.4, Lustre 2.12.5, Lustre 2.12.6
• Labels: ubuntu ubuntu18 ubuntu20
• Environment: Ubuntu 18.04 clients
• Severity: 3
• Assignee: WC Triage
• Reporter: James Nunez (Inactive)

Description

parallel-scale-nfsv4 test_ racer_on_nfs fails for Ubuntu 18.04 clients only with the following errors and hangs 100% of the time for Ubuntu 18.04 clients.

Looking at the logs for a recent failure, with logs at https://testing.whamcloud.com/test_sets/4ca25e50-6661-11e9-aeec-52540065bddc, there are several messages that may be related to the failure. In the suite_log, we see that the main issue is that the file system is read-only

== parallel-scale-nfsv4 test racer_on_nfs: racer on NFS client ======================================= 07:04:44 (1556089484)
CMD: trevis-43vm10,trevis-43vm9.trevis.whamcloud.com MDSCOUNT=1 OSTCOUNT=7 LFS=/usr/bin/lfs /usr/lib64/lustre/tests/racer/racer.sh /mnt/lustre/d0.parallel-scale-nfs
trevis-43vm9: mkdir: cannot create directory '/mnt/lustre/d0.parallel-scale-nfs': Read-only file system
trevis-43vm10: mkdir: cannot create directory '/mnt/lustre/d0.parallel-scale-nfs': Read-only file system

On the console log for the MDS (vm12), we see

[  238.469591] Lustre: DEBUG MARKER: == parallel-scale-nfsv4 test racer_on_nfs: racer on NFS client ======================================= 07:04:44 (1556089484)
[  539.092142] RPC request reserved 84 but used 100
[  545.688053] Lustre: DEBUG MARKER: /usr/sbin/lctl mark  parallel-scale-nfsv4 test_racer_on_nfs: @@@@@@ FAIL: test_racer_on_nfs failed with 1 

For a few of the failues, we don’t see this RPC message.

In the console log for both clients we see

[  228.129232] Lustre: DEBUG MARKER: == parallel-scale-nfsv4 test racer_on_nfs: racer on NFS client ======================================= 07:04:44 (1556089484)
[  228.311480] Lustre: DEBUG MARKER: MDSCOUNT=1 OSTCOUNT=7 LFS=/usr/bin/lfs /usr/lib64/lustre/tests/racer/racer.sh /mnt/lustre/d0.parallel-scale-nfs
[  265.262396] random: crng init done
[  265.263333] random: 4 urandom warning(s) missed due to ratelimiting

There are several examples of this failure, but here are just a couple of additional links to logs
https://testing.whamcloud.com/test_sets/32607d94-6358-11e9-8bb1-52540065bddc
https://testing.whamcloud.com/test_sets/4b6d37a0-6614-11e9-aeec-52540065bddc

Issue Links

• duplicates: LU-14294 parallel-scale-nfsv4 fails to start with “setup nfs failed! “ for RHEL8.3
• is related to: LU-15781 Ubuntu 22.04 LTS release support
• is related to: LU-10566 parallel-scale-nfsv4 test_metabench: mkdir: cannot create directory on Read-only file system