Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-18606

refcount_t warning when running sanityn/77j (refcount_t: addition on 0; use-after-free.)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Minor
    • None
    • None
    • None
    • 3
    • 9223372036854775807

    Description

      On Master (single node client/master) with 5.14.0-362.13.1.el9_3.x86_64. Plain venilla Rocky9.3. Running just test 77j(only manifests after fresh boot, otherwise it is not seen) gets below refcount_t warning. This is different from what Alex reported on LU-16797 will use this ticket to track Alex's report and this one below

      [  203.338271] ------------[ cut here ]------------
      [  203.338274] refcount_t: addition on 0; use-after-free.
      [  203.338289] WARNING: CPU: 1 PID: 4351 at lib/refcount.c:25 refcount_warn_saturate+0x74/0x110
      [  203.341276] Modules linked in: loop dm_flakey dm_mod lustre(OE) osp(OE) ofd(OE) lod(OE) ost(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) sunrpc libcfs(OE) rfkill intel_rapl_msr intel_rapl_common kvm_amd ccp kvm vmwgfx drm_ttm_helper ttm drm_kms_helper pcspkr irqbypass i2c_piix4 syscopyarea sysfillrect sysimgblt drm fuse ext4 mbcache jbd2 sd_mod sr_mod t10_pi cdrom sg ata_generic ahci crct10dif_pclmul crc32_pclmul libahci crc32c_intel ata_piix ghash_clmulni_intel libata e1000 video wmi serio_raw
      [  203.349883] CPU: 1 PID: 4351 Comm: ll_ost_io00_002 Kdump: loaded Tainted: G           OE     -------  ---  5.14.0-362.13.1.el9_3.x86_64 #1
      [  203.352570] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
      [  203.353977] RIP: 0010:refcount_warn_saturate+0x74/0x110
      [  203.354852] Code: 01 01 e8 0f b9 b0 ff 0f 0b e9 28 bf 66 00 80 3d 81 e0 b2 01 00 75 cb 48 c7 c7 70 97 b5 a9 c6 05 71 e0 b2 01 01 e8 ec b8 b0 ff <0f> 0b e9 05 bf 66 00 80 3d 60 e0 b2 01 00 75 a8 48 c7 c7 48 97 b5
      [  203.356648] RSP: 0018:ffff9fda409cbcd0 EFLAGS: 00010282
      [  203.357528] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000027
      [  203.358473] RDX: 0000000000000027 RSI: ffffffffaa2671e0 RDI: ffff899abdd1f888
      [  203.359397] RBP: ffff899a71339900 R08: 80000000ffff826f R09: ffff9fda409cbc58
      [  203.360292] R10: 0000000000000001 R11: 000000000000002c R12: ffff899a6b115418
      [  203.361222] R13: ffff899a6d1802b8 R14: 0000000000000002 R15: ffff9fda409cbd30
      [  203.362179] FS:  0000000000000000(0000) GS:ffff899abdd00000(0000) knlGS:0000000000000000
      [  203.363117] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
      [  203.363998] CR2: 000055b2d34eb050 CR3: 0000000017bc4000 CR4: 00000000000506e0
      [  203.364896] Call Trace:
      [  203.365762]  <TASK>
      [  203.366631]  ? srso_return_thunk+0x5/0x5f
      [  203.367507]  ? show_trace_log_lvl+0x26e/0x2df
      [  203.368352]  ? show_trace_log_lvl+0x26e/0x2df
      [  203.369178]  ? cfs_hash_bd_lookup_intent+0x72/0xd0 [libcfs]
      [  203.370033]  ? refcount_warn_saturate+0x74/0x110
      [  203.370872]  ? __warn+0x81/0x110
      [  203.371669]  ? refcount_warn_saturate+0x74/0x110
      [  203.372466]  ? report_bug+0x10a/0x140
      [  203.373256]  ? handle_bug+0x3c/0x70
      [  203.374067]  ? exc_invalid_op+0x14/0x70
      [  203.374843]  ? asm_exc_invalid_op+0x16/0x20
      [  203.375571]  ? refcount_warn_saturate+0x74/0x110
      [  203.376289]  cfs_hash_bd_lookup_intent+0x72/0xd0 [libcfs]
      [  203.377012]  nrs_tbf_jobid_hash_lookup+0xe/0x70 [ptlrpc]
      [  203.377858]  nrs_tbf_jobid_cli_find+0x72/0xb0 [ptlrpc]
      [  203.378677]  nrs_tbf_res_get+0x41/0x550 [ptlrpc]
      [  203.379455]  nrs_resource_get+0x6e/0xf0 [ptlrpc]
      [  203.380216]  nrs_resource_get_safe+0xb0/0x170 [ptlrpc]
      [  203.380954]  ptlrpc_nrs_req_initialize+0x58/0xb0 [ptlrpc]
      [  203.381693]  ptlrpc_server_request_add+0xfa/0x600 [ptlrpc]
      [  203.382452]  ptlrpc_server_handle_req_in.isra.0+0x567/0xa20 [ptlrpc]
      [  203.383205]  ptlrpc_main+0xa35/0xfa0 [ptlrpc]
      [  203.383935]  ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc]
      [  203.384645]  kthread+0xe0/0x100
      [  203.385280]  ? __pfx_kthread+0x10/0x10
      [  203.385921]  ret_from_fork+0x2c/0x50
      [  203.386525]  </TASK>
      [  203.387115] ---[ end trace 594e1023e886cdf2 ]---
      [  203.387716] ------------[ cut here ]------------
      [  203.387720] refcount_t: saturated; leaking memory.
      [  203.387742] WARNING: CPU: 0 PID: 4350 at lib/refcount.c:22 refcount_warn_saturate+0x51/0x110
      [  203.393905] Modules linked in: loop dm_flakey dm_mod lustre(OE) osp(OE) ofd(OE) lod(OE) ost(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) sunrpc libcfs(OE) rfkill intel_rapl_msr intel_rapl_common kvm_amd ccp kvm vmwgfx drm_ttm_helper ttm drm_kms_helper pcspkr irqbypass i2c_piix4 syscopyarea sysfillrect sysimgblt drm fuse ext4 mbcache jbd2 sd_mod sr_mod t10_pi cdrom sg ata_generic ahci crct10dif_pclmul crc32_pclmul libahci crc32c_intel ata_piix ghash_clmulni_intel libata e1000 video wmi serio_raw
      [  203.398522] CPU: 0 PID: 4350 Comm: ll_ost_io00_001 Kdump: loaded Tainted: G        W  OE     -------  ---  5.14.0-362.13.1.el9_3.x86_64 #1
      [  203.399279] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
      [  203.399860] RIP: 0010:refcount_warn_saturate+0x51/0x110
      [  203.400418] Code: 84 bc 00 00 00 e9 4f bf 66 00 85 f6 74 46 80 3d a5 e0 b2 01 00 75 ee 48 c7 c7 48 97 b5 a9 c6 05 95 e0 b2 01 01 e8 0f b9 b0 ff <0f> 0b e9 28 bf 66 00 80 3d 81 e0 b2 01 00 75 cb 48 c7 c7 70 97 b5
      [  203.401591] RSP: 0018:ffff9fda409c3cd0 EFLAGS: 00010282
      [  203.402667] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000027
      [  203.403259] RDX: 0000000000000027 RSI: ffffffffaa2671e0 RDI: ffff899abdc1f888
      [  203.403865] RBP: ffff899a71339900 R08: 80000000ffff829e R09: ffff9fda409c3c58
      [  203.404448] R10: 0000000000000001 R11: 0000000000000028 R12: ffff899a6b115418
      [  203.405043] R13: ffff899a6d1804a0 R14: 0000000000000002 R15: ffff9fda409c3d30
      [  203.405618] FS:  0000000000000000(0000) GS:ffff899abdc00000(0000) knlGS:0000000000000000
      [  203.406409] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
      [  203.407013] CR2: 00007efd7abfd000 CR3: 0000000017bca000 CR4: 00000000000506f0
      [  203.407608] Call Trace:
      [  203.408204]  <TASK>
      [  203.408805]  ? srso_return_thunk+0x5/0x5f
      [  203.409399]  ? show_trace_log_lvl+0x26e/0x2df
      [  203.410012]  ? show_trace_log_lvl+0x26e/0x2df
      [  203.410601]  ? cfs_hash_bd_lookup_intent+0x72/0xd0 [libcfs]
      [  203.411211]  ? refcount_warn_saturate+0x51/0x110
      [  203.411813]  ? __warn+0x81/0x110
      [  203.412399]  ? refcount_warn_saturate+0x51/0x110
      [  203.413002]  ? report_bug+0x10a/0x140
      [  203.413600]  ? handle_bug+0x3c/0x70
      [  203.414221]  ? exc_invalid_op+0x14/0x70
      [  203.414822]  ? asm_exc_invalid_op+0x16/0x20
      [  203.415415]  ? refcount_warn_saturate+0x51/0x110
      [  203.416015]  cfs_hash_bd_lookup_intent+0x72/0xd0 [libcfs]
      [  203.416619]  nrs_tbf_jobid_hash_lookup+0xe/0x70 [ptlrpc]
      [  203.417479]  nrs_tbf_jobid_cli_find+0x72/0xb0 [ptlrpc]
      [  203.418257]  nrs_tbf_res_get+0x41/0x550 [ptlrpc]
      [  203.418960]  nrs_resource_get+0x6e/0xf0 [ptlrpc]
      [  203.419642]  nrs_resource_get_safe+0xb0/0x170 [ptlrpc]
      [  203.420329]  ptlrpc_nrs_req_initialize+0x58/0xb0 [ptlrpc]
      [  203.420997]  ptlrpc_server_request_add+0xfa/0x600 [ptlrpc]
      [  203.421710]  ptlrpc_server_handle_req_in.isra.0+0x567/0xa20 [ptlrpc]
      [  203.422390]  ptlrpc_main+0xa35/0xfa0 [ptlrpc]
      [  203.423057]  ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc]
      [  203.423751]  kthread+0xe0/0x100
      [  203.424362]  ? __pfx_kthread+0x10/0x10
      [  203.424953]  ret_from_fork+0x2c/0x50
      [  203.425545]  </TASK>
      [  203.426166] ---[ end trace 594e1023e886cdf3 ]---

      Attachments

        Issue Links

          Activity

            People

              arshad512 Arshad Hussain
              arshad512 Arshad Hussain
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: