Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-13680

large allocations in osd_bufs_get() failing

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • Lustre 2.14.0
    • None
    • None
    • 3
    • 9223372036854775807

    Description

      Large allocations in osd_bufs_get() can fail if the OSS memory is fragmented after use, if that thread has not serviced a cacheless IO since startup or is newly started:

      kernel: ll_ost_io04_052: page allocation failure: order:5, mode:0x10c050
kernel: CPU: 4 PID: 1980 Comm: ll_ost_io04_052 
Call Trace:
dump_stack+0x19/0x1b
warn_alloc_failed+0x110/0x180
__alloc_pages_slowpath+0x6b6/0x724
__alloc_pages_nodemask+0x404/0x420
alloc_pages_current+0x98/0x110
__get_free_pages+0xe/0x40
kmalloc_order_trace+0x2e/0xa0
osd_bufs_get+0x7b7/0x870 [osd_ldiskfs]
ofd_preprw_read+0x2ea/0x1110 [ofd]
ofd_preprw+0x499/0x8c0 [ofd]
tgt_brw_read+0x9e3/0x1e40 [ptlrpc]
tgt_request_handle+0xada/0x1570 [ptlrpc]
ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc]
ptlrpc_main+0xb34/0x1470 [ptlrpc]

      The order 5 allocation is 128KB, so osd_bufs_get() should be using OBD_ALLOC_LARGE() or equivalent.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. LU-11347 Do not use pagecache for SSD I/O when read/write cache are disabled

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. LU-12071 bypass pagecache for large files

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            [LU-13680] large allocations in osd_bufs_get() failing
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49478/
            Subject: LU-13680 osd-ldiskfs: handle large allocations
            Project: fs/lustre-release
            Branch: b2_12
            Current Patch Set:
            Commit: 05219f018167fd2731255e56fd72b078958af639

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/49478/ Subject: LU-13680 osd-ldiskfs: handle large allocations Project: fs/lustre-release Branch: b2_12 Current Patch Set: Commit: 05219f018167fd2731255e56fd72b078958af639
            gerrit Gerrit Updater added a comment -

            "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49478
            Subject: LU-13680 osd-ldiskfs: handle large allocations
            Project: fs/lustre-release
            Branch: b2_12
            Current Patch Set: 1
            Commit: a7cfc5ffe18db69f63d4261526b0dda1914dc9bb

            gerrit Gerrit Updater added a comment - "Etienne AUJAMES <eaujames@ddn.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/49478 Subject: LU-13680 osd-ldiskfs: handle large allocations Project: fs/lustre-release Branch: b2_12 Current Patch Set: 1 Commit: a7cfc5ffe18db69f63d4261526b0dda1914dc9bb
            pjones Peter Jones added a comment -

            Landed for 2.14

            pjones Peter Jones added a comment - Landed for 2.14
            gerrit Gerrit Updater added a comment -

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38943/
            Subject: LU-13680 osd-ldiskfs: handle large allocations
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: bbb14d40a4be6a9172b80ed3208f81be2f1d1b66

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38943/ Subject: LU-13680 osd-ldiskfs: handle large allocations Project: fs/lustre-release Branch: master Current Patch Set: Commit: bbb14d40a4be6a9172b80ed3208f81be2f1d1b66
            gerrit Gerrit Updater added a comment -

            Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/38943
            Subject: LU-13680 osd-ldiskfs: handle large allocations
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 5cab7541253e2f83bba1e6725f97708bfc1679eb

            gerrit Gerrit Updater added a comment - Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/38943 Subject: LU-13680 osd-ldiskfs: handle large allocations Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 5cab7541253e2f83bba1e6725f97708bfc1679eb

            People

              adilger Andreas Dilger
              adilger Andreas Dilger
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: