Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-17573

lets use ext4 limit for uninitiated object.

Details

    • 3
    • 9223372036854775807

    Description

      [root@devel1 tests]# ../utils/lfs setstripe -E 4M -L raid0 -c 1 -E -1 -L raid0 -c 2 /mnt/lustre/pfl-file
      [root@devel1 tests]# truncate -s 30TB /mnt/lustre/pfl-file
      truncate: не удалось усечь '/mnt/lustre/pfl-file' на 30000000000000 байт: Файл слишком велик
      [root@devel1 tests]# truncate -s 2TB /mnt/lustre/pfl-file
      [root@devel1 tests]# truncate -s 30TB /mnt/lustre/pfl-file

      Attachments

        Issue Links

          Activity

            [LU-17573] lets use ext4 limit for uninitiated object.

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/56100/
            Subject: LU-17573 lov: change default object size.
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set:
            Commit: 439599802917ae998d322310a93860090f5cf6e8

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/56100/ Subject: LU-17573 lov: change default object size. Project: fs/lustre-release Branch: b2_15 Current Patch Set: Commit: 439599802917ae998d322310a93860090f5cf6e8

            It would be useful if there was a sanity-pfl test case for this patch, like what is described in the original description.

            adilger Andreas Dilger added a comment - It would be useful if there was a sanity-pfl test case for this patch, like what is described in the original description.
            carbonneau Eric Carbonneau added a comment - - edited

            We encountered a similar isssue after setting PFL and all OSTs ended up with a file too large error:

            here is how we reproduced the error:
            ===================================================
            [faaland1@mutt9 pfltest] $mkdir nopfl pfl-one pfl-two
            [faaland1@mutt9 pfltest] $lfs setstripe -E 256G -c2 -S 16M -E -1 -c -1 pfl-two
            [faaland1@mutt9 pfltest] $lfs setstripe -E -1 -c -1 pfl-one
            [faaland1@mutt9 pfltest] $lfs setstripe -c -1 -S 16M nopfl
            [faaland1@mutt9 pfltest] $pwd
            /p/lflood/faaland1/test/pfltest
            [faaland1@mutt9 pfltest] $lfs check servers .
            lflood-OST0000-osc-ff1a28194597d000 active.
            lflood-OST0001-osc-ff1a28194597d000 active.
            lflood-OST0002-osc-ff1a28194597d000 active.
            lflood-OST0003-osc-ff1a28194597d000 active.
            lflood-MDT0000-mdc-ff1a28194597d000 active.
            lflood-MDT0001-mdc-ff1a28194597d000 active.
            lflood-MDT0002-mdc-ff1a28194597d000 active.
            lflood-MDT0003-mdc-ff1a28194597d000 active.
            MGC172.19.1.133@o2ib100 active.
            [faaland1@mutt9 pfltest] $for xx in *; do echo $xx; dd if=/dev/zero bs=1 seek=$((8*2))T of=${xx}/16TB count=1; echo; done 2>&1
            nopfl
            1+0 records in
            1+0 records out
            1 byte copied, 0.0006174 s, 1.6 kB/s

            pfl-one
            1+0 records in
            1+0 records out
            1 byte copied, 0.000456144 s, 2.2 kB/s

            pfl-two
            dd: failed to truncate to 17592186044416 bytes in output file 'pfl-two/16TB': File too large
            ==============================================

            If one of the watcher could xonfirm the current fix for this ticket really address the error we encountered.

            thanks

            carbonneau Eric Carbonneau added a comment - - edited We encountered a similar isssue after setting PFL and all OSTs ended up with a file too large error: here is how we reproduced the error: =================================================== [faaland1@mutt9 pfltest] $mkdir nopfl pfl-one pfl-two [faaland1@mutt9 pfltest] $lfs setstripe -E 256G -c2 -S 16M -E -1 -c -1 pfl-two [faaland1@mutt9 pfltest] $lfs setstripe -E -1 -c -1 pfl-one [faaland1@mutt9 pfltest] $lfs setstripe -c -1 -S 16M nopfl [faaland1@mutt9 pfltest] $pwd /p/lflood/faaland1/test/pfltest [faaland1@mutt9 pfltest] $lfs check servers . lflood-OST0000-osc-ff1a28194597d000 active. lflood-OST0001-osc-ff1a28194597d000 active. lflood-OST0002-osc-ff1a28194597d000 active. lflood-OST0003-osc-ff1a28194597d000 active. lflood-MDT0000-mdc-ff1a28194597d000 active. lflood-MDT0001-mdc-ff1a28194597d000 active. lflood-MDT0002-mdc-ff1a28194597d000 active. lflood-MDT0003-mdc-ff1a28194597d000 active. MGC172.19.1.133@o2ib100 active. [faaland1@mutt9 pfltest] $for xx in *; do echo $xx; dd if=/dev/zero bs=1 seek=$((8*2))T of=${xx}/16TB count=1; echo; done 2>&1 nopfl 1+0 records in 1+0 records out 1 byte copied, 0.0006174 s, 1.6 kB/s pfl-one 1+0 records in 1+0 records out 1 byte copied, 0.000456144 s, 2.2 kB/s pfl-two dd: failed to truncate to 17592186044416 bytes in output file 'pfl-two/16TB': File too large ============================================== If one of the watcher could xonfirm the current fix for this ticket really address the error we encountered. thanks

            "Eric Carbonneau <carbonneau1@llnl.gov>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56100
            Subject: LU-17573 lov: change default object size.
            Project: fs/lustre-release
            Branch: b2_15
            Current Patch Set: 1
            Commit: dd932b9eb0fd06a5c97687f3020573955df5c590

            gerrit Gerrit Updater added a comment - "Eric Carbonneau <carbonneau1@llnl.gov>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/56100 Subject: LU-17573 lov: change default object size. Project: fs/lustre-release Branch: b2_15 Current Patch Set: 1 Commit: dd932b9eb0fd06a5c97687f3020573955df5c590
            pjones Peter Jones added a comment -

            Merged for 2.16

            pjones Peter Jones added a comment - Merged for 2.16

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/54137/
            Subject: LU-17573 lov: change default object size.
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: f315a3a594a78ecd47fcd74177fa73fb2efff59c

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/54137/ Subject: LU-17573 lov: change default object size. Project: fs/lustre-release Branch: master Current Patch Set: Commit: f315a3a594a78ecd47fcd74177fa73fb2efff59c

            "Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/54137
            Subject: LU-17573 lov: change default object size.
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: d3cc01bc96be83668c668cebeeca99c9470c9422

            gerrit Gerrit Updater added a comment - "Alexey Lyashkov <alexey.lyashkov@hpe.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/54137 Subject: LU-17573 lov: change default object size. Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: d3cc01bc96be83668c668cebeeca99c9470c9422

            People

              shadow Alexey Lyashkov
              shadow Alexey Lyashkov
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: