[LU-16687] sanityn test_109: Fail to remove lustre modules

• Status: Open
• Project: Lustre
• Type: Bug
• Priority: Minor
• Reporter: Maloo
• Assignee: WC Triage
• Resolution: Unresolved
• Severity: 3

Description

This issue was created by maloo for Chris Horn <[e-mail]>

This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/d257ac87-e815-4cc8-9b3f-07f229bea20f

test_109 failed with the following error:

Fail to remove lustre modules

Test session details:
clients: https://build.whamcloud.com/job/lustre-reviews/93383 - 4.18.0-372.32.1.el8_6.x86_64
servers: https://build.whamcloud.com/job/lustre-reviews/93383 - 4.18.0-372.32.1.el8_lustre.x86_64

Failed to remove libcfs module on second iteration:

Iteration 2
Starting client: onyx-130vm5.onyx.whamcloud.com:  -o user_xattr,flock onyx-130vm8@tcp:/lustre /mnt/lustre
CMD: onyx-130vm5.onyx.whamcloud.com mkdir -p /mnt/lustre
Starting client: onyx-130vm5.onyx.whamcloud.com:  -o user_xattr,flock onyx-130vm8@tcp:/lustre /mnt/lustre2
CMD: onyx-130vm5.onyx.whamcloud.com mkdir -p /mnt/lustre2
CMD: onyx-130vm5.onyx.whamcloud.com mount -t lustre -o user_xattr,flock onyx-130vm8@tcp:/lustre /mnt/lustre
CMD: onyx-130vm5.onyx.whamcloud.com mount -t lustre -o user_xattr,flock onyx-130vm8@tcp:/lustre /mnt/lustre2
10.240.30.159@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0
10.240.30.159@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0
CMD: onyx-130vm5.onyx.whamcloud.com grep -c /mnt/lustre2' ' /proc/mounts
CMD: onyx-130vm5.onyx.whamcloud.com grep -c /mnt/lustre' ' /proc/mounts
Stopping client onyx-130vm5.onyx.whamcloud.com /mnt/lustre2 (opts:)
CMD: onyx-130vm5.onyx.whamcloud.com lsof -t /mnt/lustre2
Stopping client onyx-130vm5.onyx.whamcloud.com /mnt/lustre (opts:)
CMD: onyx-130vm5.onyx.whamcloud.com lsof -t /mnt/lustre
CMD: onyx-130vm5.onyx.whamcloud.com umount  /mnt/lustre2 2>&1
CMD: onyx-130vm5.onyx.whamcloud.com umount  /mnt/lustre 2>&1
rmmod: ERROR: Module libcfs is in use
 sanityn test_109: @@@@@@ FAIL: Fail to remove lustre modules 
  Trace dump:
  = /usr/lib64/lustre/tests/test-framework.sh:6549:error()
  = /usr/lib64/lustre/tests/sanityn.sh:5879:test_109()
  = /usr/lib64/lustre/tests/test-framework.sh:6887:run_one()
  = /usr/lib64/lustre/tests/test-framework.sh:6937:run_one_logged()
  = /usr/lib64/lustre/tests/test-framework.sh:6773:run_test()
  = /usr/lib64/lustre/tests/sanityn.sh:5888:main()
Dumping lctl log to /autotest/autotest-2/2023-03-29/lustre-reviews_review-dne-part-5_93383_7_1a6352ce-1a4c-4436-8487-88b3bc7f267e//sanityn.test_109.*.1680136094.log
CMD: onyx-130vm15,onyx-130vm5.onyx.whamcloud.com,onyx-130vm6,onyx-130vm7,onyx-130vm8 /usr/sbin/lctl dk > /autotest/autotest-2/2023-03-29/lustre-reviews_review-dne-part-5_93383_7_1a6352ce-1a4c-4436-8487-88b3bc7f267e//sanityn.test_109.debug_log.\$(hostname -s).1680136094.log;
		dmesg > /autotest/autotest-2/2023-03-29/lustre-reviews_review-dne-part-5_93383_7_1a6352ce-1a4c-4436-8487-88b3bc7f267e//sanityn.test_109.dmesg.\$(hostname -s).1680136094.log

VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV
sanityn test_109 - Fail to remove lustre modules

Comments

[Chris Horn]

This test failure resulted in the filesystem being unmounted from the test client. This impacted subsequent tests:
1. test_110() incorrectly passed
2. test_112() and test_113() failed

[Gerrit Updater]

"Alex Zhuravlev <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51705
Subject: LU-16687 tests: reproducer
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 81846bbc940eb98b5c39e42d85a004b789054305