Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-21149

sanity-sec test_31: rmmod fails with Module mdd is in use at teardown, later subtests fail with no lnet

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Medium Medium
    • None
    • None
    • None
    • 3
    • 9223372036854775807

      sanity-sec test_31 fails at teardown with "lustre_rmmod: wait 40s for mdd (refcnt N)" then "rmmod: ERROR: Module mdd is in use" (unload_modules_local, ssh exit 2, "test_31 returned 2"). The target modules stay loaded on the MDS node, so the cluster is left with no usable lnet. Every later sanity-sec subtest of the test set then fails: "opening /dev/lnet failed: No such file or directory", lctl list_nids returns no tcp NID, "Add range @tcp to c0 failed rc = 4" (test_64a..64k), "Add range <nid>@tcp rc = 1" (84, 85, 93), "mgs and active mismatch" (34, 72a, 72b), "cannot add nodemap" (86), "mount failed" (300), "umount failed", "mkdir failed".

      Seen on review-dne-zfs-part-2 el10.2 (mdd in use on the second MDS, onyx-159vm200, after both of its MDTs reported "server umount complete") and on other changes' runs of the same test, with the in-use module varying (mdd, osp, mdt): change 69420 ps4 (review-dne-zfs-part-2 and review-dne-part-2, 2026-10-31), change 63511 ps38 (review-dne-part-2, 2026-10-26), change 61016 ps11 (review-ldiskfs-arm and review-ldiskfs-ubuntu, 2026-09-11). Rate on lustre-reviews is about 0.2 percent of runs per config. The signature "test_31 returned 2" has been linked to LU-16796 (an unrelated refcount cleanup ticket), and the cascade subtests to LU-18461 (JOIN files), neither of which describes this. It is not caused by the fscrypt change under test (LU-17916 macros, client side only).

      Failed test set: sanity-sec in session 9720e2ca-0545-4768-9c78-cabba3950a83 (lustre-reviews build 135501, review-dne-zfs-part-2), test_set fca16bc7-ff1c-4e4e-9f20-699867202728, subtest test_31 cda901f7-4bc6-44c0-b13e-a2512de97078. Not established: what holds the module reference after the last umount (a device or reference not released after the MDT umount -f).

      Raised by Patch Watcher run pw-engineer-69650-ps8-6db03c52655c on https://review.whamcloud.com/69650

            wc-triage WC Triage
            maloo Maloo
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: