Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-18347

dd: failed to truncate to 17592186044416 bytes in output file 'pfl-two/16TB': File too large

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • None
    • Lustre 2.15.6
    • None
    • 3
    • 9223372036854775807

    Description

      Error creating file when using PFL:

      [faaland1@mutt9 pfltest] $mkdir nopfl pfl-one pfl-two
      [faaland1@mutt9 pfltest] $lfs setstripe -E 256G -c2 -S 16M -E -1 -c -1 pfl-two
      [faaland1@mutt9 pfltest] $lfs setstripe -E -1 -c -1 pfl-one
      [faaland1@mutt9 pfltest] $lfs setstripe -c -1 -S 16M nopfl
      [faaland1@mutt9 pfltest] $pwd
      /p/lflood/faaland1/test/pfltest
      [faaland1@mutt9 pfltest] $lfs check servers .
      lflood-OST0000-osc-ff1a28194597d000 active.
      lflood-OST0001-osc-ff1a28194597d000 active.
      lflood-OST0002-osc-ff1a28194597d000 active.
      lflood-OST0003-osc-ff1a28194597d000 active.
      lflood-MDT0000-mdc-ff1a28194597d000 active.
      lflood-MDT0001-mdc-ff1a28194597d000 active.
      lflood-MDT0002-mdc-ff1a28194597d000 active.
      lflood-MDT0003-mdc-ff1a28194597d000 active.
      MGC172.19.1.133@o2ib100 active.
      [faaland1@mutt9 pfltest] $for xx in *; do echo $xx; dd if=/dev/zero bs=1 seek=$((8*2))T of=${xx}/16TB count=1; echo; done 2>&1
      nopfl
      1+0 records in
      1+0 records out
      1 byte copied, 0.0006174 s, 1.6 kB/s
      pfl-one
      1+0 records in
      1+0 records out
      1 byte copied, 0.000456144 s, 2.2 kB/s
      pfl-two
      dd: failed to truncate to 17592186044416 bytes in output file 'pfl-two/16TB': File too large 

      Attachments

        Issue Links

          Activity

            [LU-18347] dd: failed to truncate to 17592186044416 bytes in output file 'pfl-two/16TB': File too large
            pjones Peter Jones added a comment -

            2.15.6 GA including the fix in question

            pjones Peter Jones added a comment - 2.15.6 GA including the fix in question
            pjones Peter Jones added a comment -

            Fix merged for 2.15.6

            pjones Peter Jones added a comment - Fix merged for 2.15.6

            ofaaland, yes, this patch increases the mjnimum per-object limit from 2TiB to 16TiB for objects that are not initialized. For ZFS this limit would not apply, but the client doesn't know the objects are on ZFS until after they are allocated.

            adilger Andreas Dilger added a comment - ofaaland , yes, this patch increases the mjnimum per-object limit from 2TiB to 16TiB for objects that are not initialized. For ZFS this limit would not apply, but the client doesn't know the objects are on ZFS until after they are allocated.

            Please confirm this patch is the correct fix.  It appears to work in our testing.

            ofaaland Olaf Faaland added a comment - Please confirm this patch is the correct fix.  It appears to work in our testing.

            Eric Carbonneau pushed a backport for b2_15:

            https://review.whamcloud.com/c/fs/lustre-release/+/56100

            ofaaland Olaf Faaland added a comment - Eric Carbonneau pushed a backport for b2_15: https://review.whamcloud.com/c/fs/lustre-release/+/56100
            ofaaland Olaf Faaland added a comment - - edited

            We believe this to be the same as LU-17573

            ofaaland Olaf Faaland added a comment - - edited We believe this to be the same as LU-17573

            People

              adilger Andreas Dilger
              ofaaland Olaf Faaland
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: