Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-20177

Directory migration failed Directory not empty (39)

XMLWordPrintable

    • Icon: Requirement Requirement
    • Resolution: Unresolved
    • Icon: Medium Medium
    • None
    • None
    • None
    • 3
    • 9223372036854775807

      this test fails with error 39

      #!/bin/bash
      set -euo pipefail

      MDTEST_BIN="/home/rocky/build/ior/src/mdtest"
      dirname="/mnt/lustre/rajeevm/test_dir"

      echo "Using dir: $dirname"
      echo "Using mdtest: $MDTEST_BIN"
      rm -fr $dirname
      sudo lctl set_param mdt.*.enable_dir_restripe=1
      sudo lctl set_param mdt.*.dir_restripe_nsonly=0

      1. Ensure parent directory exists
        sudo chown "$USER:$USER" /mnt/lustre
        if [ ! -d "/mnt/lustre/rajeevm" ]; then
        echo "Creating parent dir /mnt/lustre/rajeevm ..."
        sudo mkdir -p /mnt/lustre/rajeevm
        sudo chown "$USER:$USER" /mnt/lustre/rajeevm
        fi
      1. Clean old test dir (optional)
        if [ -e "$dirname" ]; then
        sudo rm -rf "$dirname"
        fi

      echo "=== sudo lfs mkdir --mdt-index 1 --mdt-count 2 $dirname ==="

      1. Create target dir on MDTs
        sudo lfs mkdir --mdt-index 1 --mdt-count 2 "$dirname"
        sudo chown "$USER:$USER" "$dirname"
        echo "=== $MDTEST_BIN -w 16384 -f 1 -l 1 -i 1 -C -n 500 -t -T -v -v -E -d $dirname -u ==="
      2. Run mdtest (single-process, no MPI launcher)
        #"$MDTEST_BIN" -w 16384 -f 1 -l 1 -i 2 -C -n 50000 -t -T -v -v -E -d "$dirname" -u
        "$MDTEST_BIN" -w 16384 -f 1 -l 1 -i 1 -C -n 1 -t -T -v -v -E -d "$dirname" -u
        echo "=== Enabling all Lustre debug ==="
        sudo lctl set_param debug=+all
        sudo lctl set_param debug_mb=256
        sudo lctl clear
        sudo lctl mark "=== START OF RAJEEV DEBUG Migrate ==="
      1. Repro step: migrate
        sudo lfs migrate -v --mdt-index 0 --mdt-count 1 "$dirname"
        sudo lctl mark "=== END OF RAJEEV DEBUG Migrate ==="
        sudo lctl dk > /tmp/lustre-migrate-debug.log
        sudo lctl set_param debug=0
        echo "Log saved to /tmp/lustre-migrate-debug.log"
        echo "Done."

      tree.0.0
      V-1: Rank 0 Line 611 Entering mdtest_read on /mnt/lustre/rajeevm/test_dir/#test-dir.0-0/mdtest_tree.0.0
      V-1: Rank 0 Line 1219 File creation : 0.009 sec, 109.879 ops/sec
      V-1: Rank 0 Line 1223 File stat : 0.001 sec, 950.243 ops/sec
      V-1: Rank 0 Line 1224 File read : 0.004 sec, 264.120 ops/sec
      V-1: Rank 0 Line 1225 File removal : 0.000 sec, 0.000 ops/sec
      V-1: Rank 0 Line 1237 Entering summarize_results...

      SUMMARY rate: (of 1 iterations)
      Operation Max Min Mean Std Dev
      --------- — — ---- -------
      Directory creation : 192.335 192.335 192.335 0.000
      Directory stat : 442.647 442.647 442.647 0.000
      Directory removal : 0.000 0.000 0.000 0.000
      File creation : 109.879 109.879 109.879 0.000
      File stat : 950.243 950.243 950.243 0.000
      File read : 264.120 264.120 264.120 0.000
      File removal : 0.000 0.000 0.000 0.000
      Tree creation : 197.015 197.015 197.015 0.000
      Tree removal : 0.000 0.000 0.000 0.000
      V-1: Entering PrintTimestamp...
      – finished at 04/21/2026 15:30:59 –

      === Enabling all Lustre debug ===
      debug=+all
      debug_mb=256
      migrate /mnt/lustre/rajeevm/test_dir to MDT0 stripe count 1
      /mnt/lustre/rajeevm/test_dir/#test-dir.0-0 migrated to MDT0 already
      /mnt/lustre/rajeevm/test_dir/#test-dir.0-0/mdtest_tree.0.0 migrated to MDT0 already
      migrate /mnt/lustre/rajeevm/test_dir/#test-dir.0-0/mdtest_tree.0.0/file.mdtest.0.0 to MDT0 stripe count 1
      /mnt/lustre/rajeevm/test_dir/#test-dir.0-0/mdtest_tree.0.0/dir.mdtest.0.0 migrated to MDT0 already
      lfs migrate: cb_migrate_mdt_fini: error completing migration of /mnt/lustre/rajeevm/test_dir: Directory not empty (39)

            rajeevm Rajeev Mishra
            rajeevm Rajeev Mishra
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: