Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-8100

Missing MDTs in /proc/fs/lustre/lmv/lustre-clilmv-.../target_obd

Details

    • Bug
    • Resolution: Fixed
    • Major
    • Lustre 2.9.0
    • Lustre 2.8.0
    • lustre-2.8.0_14_gd0cbf68-1.x86_64
      2.6.32-573.22.1.1chaos.ch5.4.x86_64
    • 3
    • 9223372036854775807

    Description

      Our test setup contains 16 MDTs. Our clients only ever see 10 MDTs. All output below is from a client with the file system mounted. All were formatted at the same time with the same script and same mgs nid.

      Attempts to use any MDT that is not listed fails (i.e. lfs mkdir --index=10 will fail).

      [root@catalyst320:mdc]# lfs mkdir --index=12 /p/lustre/dinatale/testdir
error on LL_IOC_LMV_SETSTRIPE '/p/lustre/dinatale/testdir' (3): No such device
error: mkdir: create stripe dir '/p/lustre/dinatale/testdir' failed
[root@catalyst320:mdc]# lfs mkdir --index=8 /p/lustre/dinatale/testdir
[root@catalyst320:mdc]# lfs getdirstripe /p/lustre/dinatale/testdir/        
/p/lustre/dinatale/testdir/
lmv_stripe_count: 0 lmv_stripe_offset: 8

      [root@catalyst320:mdc]# cat /proc/fs/lustre/lmv/lustre-clilmv-ffff881003e14400/target_obd
0: lustre-MDT0000_UUID ACTIVE
1: lustre-MDT0001_UUID ACTIVE
2: lustre-MDT0002_UUID ACTIVE
3: lustre-MDT0003_UUID ACTIVE
4: lustre-MDT0004_UUID ACTIVE
5: lustre-MDT0005_UUID ACTIVE
6: lustre-MDT0006_UUID ACTIVE
7: lustre-MDT0007_UUID ACTIVE
8: lustre-MDT0008_UUID ACTIVE
9: lustre-MDT0009_UUID ACTIVE

      ls /proc/fs/lustre/lmv/lustre-clilmv-ffff881003e14400/target_obds/
lustre-MDT0000-mdc-ffff881003e14400  lustre-MDT0006-mdc-ffff881003e14400  lustre-MDT0012-mdc-ffff881003e14400
lustre-MDT0001-mdc-ffff881003e14400  lustre-MDT0007-mdc-ffff881003e14400  lustre-MDT0013-mdc-ffff881003e14400
lustre-MDT0002-mdc-ffff881003e14400  lustre-MDT0008-mdc-ffff881003e14400  lustre-MDT0014-mdc-ffff881003e14400
lustre-MDT0003-mdc-ffff881003e14400  lustre-MDT0009-mdc-ffff881003e14400  lustre-MDT0015-mdc-ffff881003e14400
lustre-MDT0004-mdc-ffff881003e14400  lustre-MDT0010-mdc-ffff881003e14400
lustre-MDT0005-mdc-ffff881003e14400  lustre-MDT0011-mdc-ffff881003e14400

      [root@catalyst320:mdc]# grep current_state */state
lustre-MDT0000-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0001-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0002-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0003-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0004-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0005-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0006-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0007-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0008-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0009-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0010-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0011-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0012-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0013-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0014-mdc-ffff881003e14400/state:current_state: FULL
lustre-MDT0015-mdc-ffff881003e14400/state:current_state: FULL

      Attachments

        Activity

          [LU-8100] Missing MDTs in /proc/fs/lustre/lmv/lustre-clilmv-.../target_obd
          mdiep Minh Diep made changes -
          Link Original: This issue is related to JFC-17 [ JFC-17 ]
          mdiep Minh Diep made changes -
          Link New: This issue is blocked by JFC-20 [ JFC-20 ]
          mdiep Minh Diep made changes -
          Link Original: This issue is related to JFC-24 [ JFC-24 ]
          mdiep Minh Diep made changes -
          Link Original: This issue is related to LDEV-341 [ LDEV-341 ]
          mdiep Minh Diep made changes -
          Link New: This issue is blocked by LDEV-342 [ LDEV-342 ]
          mdiep Minh Diep made changes -
          Link New: This issue is related to JFC-24 [ JFC-24 ]
          pjones Peter Jones made changes -
          Link New: This issue is related to JFC-17 [ JFC-17 ]
          pjones Peter Jones made changes -
          Resolution New: Fixed [ 1 ]
          Status Original: Open [ 1 ] New: Resolved [ 5 ]
          pjones Peter Jones added a comment -

          Landed for 2.9

          pjones Peter Jones added a comment - Landed for 2.9
          gerrit Gerrit Updater added a comment -

          Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/20546/
          Subject: LU-8100 tests: Test the correctness of target_obd
          Project: fs/lustre-release
          Branch: master
          Current Patch Set:
          Commit: 1a8c46a434b20c1083fafbded4d39e6dbbdff37a

          gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/20546/ Subject: LU-8100 tests: Test the correctness of target_obd Project: fs/lustre-release Branch: master Current Patch Set: Commit: 1a8c46a434b20c1083fafbded4d39e6dbbdff37a

          People

            laisiyao Lai Siyao
            dinatale2 Giuseppe Di Natale (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: