Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-8100

Missing MDTs in /proc/fs/lustre/lmv/lustre-clilmv-.../target_obd

Details

    • Bug
    • Resolution: Fixed
    • Major
    • Lustre 2.9.0
    • Lustre 2.8.0
    • lustre-2.8.0_14_gd0cbf68-1.x86_64
      2.6.32-573.22.1.1chaos.ch5.4.x86_64
    • 3
    • 9223372036854775807

    Description

      Our test setup contains 16 MDTs. Our clients only ever see 10 MDTs. All output below is from a client with the file system mounted. All were formatted at the same time with the same script and same mgs nid.

      Attempts to use any MDT that is not listed fails (i.e. lfs mkdir --index=10 will fail).

      [root@catalyst320:mdc]# lfs mkdir --index=12 /p/lustre/dinatale/testdir
      error on LL_IOC_LMV_SETSTRIPE '/p/lustre/dinatale/testdir' (3): No such device
      error: mkdir: create stripe dir '/p/lustre/dinatale/testdir' failed
      [root@catalyst320:mdc]# lfs mkdir --index=8 /p/lustre/dinatale/testdir
      [root@catalyst320:mdc]# lfs getdirstripe /p/lustre/dinatale/testdir/        
      /p/lustre/dinatale/testdir/
      lmv_stripe_count: 0 lmv_stripe_offset: 8
      
      [root@catalyst320:mdc]# cat /proc/fs/lustre/lmv/lustre-clilmv-ffff881003e14400/target_obd
      0: lustre-MDT0000_UUID ACTIVE
      1: lustre-MDT0001_UUID ACTIVE
      2: lustre-MDT0002_UUID ACTIVE
      3: lustre-MDT0003_UUID ACTIVE
      4: lustre-MDT0004_UUID ACTIVE
      5: lustre-MDT0005_UUID ACTIVE
      6: lustre-MDT0006_UUID ACTIVE
      7: lustre-MDT0007_UUID ACTIVE
      8: lustre-MDT0008_UUID ACTIVE
      9: lustre-MDT0009_UUID ACTIVE
      
      ls /proc/fs/lustre/lmv/lustre-clilmv-ffff881003e14400/target_obds/
      lustre-MDT0000-mdc-ffff881003e14400  lustre-MDT0006-mdc-ffff881003e14400  lustre-MDT0012-mdc-ffff881003e14400
      lustre-MDT0001-mdc-ffff881003e14400  lustre-MDT0007-mdc-ffff881003e14400  lustre-MDT0013-mdc-ffff881003e14400
      lustre-MDT0002-mdc-ffff881003e14400  lustre-MDT0008-mdc-ffff881003e14400  lustre-MDT0014-mdc-ffff881003e14400
      lustre-MDT0003-mdc-ffff881003e14400  lustre-MDT0009-mdc-ffff881003e14400  lustre-MDT0015-mdc-ffff881003e14400
      lustre-MDT0004-mdc-ffff881003e14400  lustre-MDT0010-mdc-ffff881003e14400
      lustre-MDT0005-mdc-ffff881003e14400  lustre-MDT0011-mdc-ffff881003e14400
      
      [root@catalyst320:mdc]# grep current_state */state
      lustre-MDT0000-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0001-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0002-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0003-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0004-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0005-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0006-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0007-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0008-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0009-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0010-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0011-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0012-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0013-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0014-mdc-ffff881003e14400/state:current_state: FULL
      lustre-MDT0015-mdc-ffff881003e14400/state:current_state: FULL
      

      Attachments

        Activity

          People

            laisiyao Lai Siyao
            dinatale2 Giuseppe Di Natale (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: