[LU-13601] page allocation failure during mount

• Type: Bug
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.15.0
• Affects Version/s: Upstream, Lustre 2.12.4
• Severity: 3
• Assignee: Andreas Dilger
• Reporter: Alexander Zarochentsev

Description

A customer mounts several lustre fs , 10th fs is failed to mount due to a memory allocation failure.

[7335638.554981] mount.lustre: page allocation failure: order:4, mode:0xc050
[7335638.554990] CPU: 0 PID: 303506 Comm: mount.lustre Kdump: loaded Tainted: G           OE  ------------ T 3.10.0-957.41.1.el7.x86
_64 #1
[7335638.554992] Hardware name: Penguin Computing XE2142e-OEM/S2600BPS, BIOS SE5C620.86B.00.01.0016.020120190930 02/01/2019
[7335638.554994] Call Trace:
[7335638.555012]  [<ffffffffae565ac0>] dump_stack+0x19/0x1b
[7335638.555022]  [<ffffffffadfbe200>] warn_alloc_failed+0x110/0x180
[7335638.555025]  [<ffffffffadfc2cbf>] __alloc_pages_nodemask+0x9df/0xbe0
[7335638.555029]  [<ffffffffae00fce8>] alloc_pages_current+0x98/0x110
[7335638.555035]  [<ffffffffadfddb68>] kmalloc_order+0x18/0x40
[7335638.555042]  [<ffffffffae01b066>] kmalloc_order_trace+0x26/0xa0
[7335638.555095]  [<ffffffffc0f94eec>] ll_init_sbi+0x4c/0x660 [lustre]
[7335638.555154]  [<ffffffffc0ae7be2>] ? lustre_start_mgc+0x4d2/0x2b00 [obdclass]
[7335638.555157]  [<ffffffffae01df36>] ? kmem_cache_alloc_trace+0x1d6/0x200
[7335638.555169]  [<ffffffffc0fa145a>] ? ll_fill_super+0x7a/0x14e0 [lustre]
[7335638.555179]  [<ffffffffc0fa14b5>] ll_fill_super+0xd5/0x14e0 [lustre]
[7335638.555196]  [<ffffffffc0aeac04>] lustre_fill_super+0x264/0xb70 [obdclass]
[7335638.555210]  [<ffffffffc0aea9a0>] ? lustre_common_put_super+0x270/0x270 [obdclass]
[7335638.555216]  [<ffffffffae046e3f>] mount_nodev+0x4f/0xb0
[7335638.555230]  [<ffffffffc0ae07c8>] lustre_mount+0x38/0x60 [obdclass]
[7335638.555232]  [<ffffffffae0479be>] mount_fs+0x3e/0x1b0
[7335638.555237]  [<ffffffffae065607>] vfs_kern_mount+0x67/0x110
[7335638.555238]  [<ffffffffae067c2f>] do_mount+0x1ef/0xce0
[7335638.555242]  [<ffffffffae03fe1a>] ? __check_object_size+0x1ca/0x250
[7335638.555244]  [<ffffffffae01dd9c>] ? kmem_cache_alloc_trace+0x3c/0x200
[7335638.555246]  [<ffffffffae068a63>] SyS_mount+0x83/0xd0
[7335638.555249]  [<ffffffffae578ddb>] system_call_fastpath+0x22/0x27
[7335638.555251] Mem-Info:
[7335638.555264] active_anon:85113660 inactive_anon:4989547 isolated_anon:0
 active_file:1793179 inactive_file:2080266 isolated_file:0
 unevictable:0 dirty:26440 writeback:34 unstable:0
 slab_reclaimable:836114 slab_unreclaimable:1111382
 mapped:810319 shmem:25487119 pagetables:149686 bounce:0
 free:243878 free_pcp:287 free_cma:0

Issue Links

• is related to: LU-4533 rpc_stats histogram does not support max_rpcs_in_flight greater than 31
• is related to: LU-14055 Write performance regression caused by an commit from LU-13344