Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-20770

interop sanity-pfl,sanityn: Request sent has failed due to network error

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • None
    • None
    • 3
    • 9223372036854775807

      This issue was created by maloo for Marc Vef <mvef@whamcloud.com>

      This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/3c628647-fcd6-4cf7-9e18-411dbdb17121

      test_2b failed with the following error:

      Read first component failed
      

      Test session details:

      Interop

      Client
      Lustre: 2.17.58.40
      Branch: master
      Build: https://build.whamcloud.com/job/lustre-reviews/131807
      Kernel: 5.14.0-611.55.1.el9_7.x86_64

      Server
      Lustre: 2.16.1.2
      Branch: b2_16
      Build: https://build.whamcloud.com/job/lustre-b2_16/6
      Kernel: 5.14.0-427.31.1_lustre.el9.x86_64

      client: sanity-pfl.test_2b.dmesg.onyx-157vm118.1789548470.log

      [  694.945008] Lustre: DEBUG MARKER: == sanity-pfl test 2b: Add components w/DOM to existing file ====
      [  695.243353] Lustre: 3576:0:(client.c:2498:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1789548413/real 1789548413]  req@ff2d304c65f1cd00 x1876476901654144/t0(0) o4->lustre-MDT0003-mdc-ff2d304c4563a800@10.240.24.223@tcp:13/10 lens 488/448 e 0 to 1 dl 1789548429 ref 2 fl Rpc:eXQr/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0
      [  695.243478] Lustre: lustre-MDT0003-mdc-ff2d304c4563a800: Connection to lustre-MDT0003 (at 10.240.24.223@tcp) was lost; in progress operations using this service will wait for recovery to complete
      [  751.690976] LustreError: lustre-MDT0003-mdc-ff2d304c4563a800: This client was evicted by lustre-MDT0003; in progress operations using this service will fail.
      [  751.693994] Lustre: 3576:0:(llite_lib.c:4337:ll_dirty_page_discard_warn()) lustre: dirty page discard: 10.240.30.65@tcp:/lustre/fid: [0x2c0000404:0x73f:0x0]// may get corrupted (rc -5)
      [  751.694842] LustreError: 53676:0:(file.c:250:ll_close_inode_openhandle()) lustre-clilmv-ff2d304c4563a800: inode [0x240000404:0x3a0:0x0] mdc close failed: rc = -108 

      MDS sanity-pfl.test_2b.dmesg.onyx-157vm266.1789548470.log

      [  695.469005] LustreError: 5350:0:(events.c:472:server_bulk_callback()) event type 3, status -113, desc ff3910b733a89c00
      [  695.469135] LustreError: 5386:0:(ldlm_lib.c:3562:target_bulk_io()) @@@ network error on bulk WRITE  req@ff3910b72b3a5d40 x1876476901654144/t0(0) o4->490d3f0d-2f99-4a59-ba28-25cc87930d47@10.240.28.36@tcp:614/0 lens 488/448 e 0 to 0 dl 1789548424 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0
      [  725.053126] Lustre: lustre-MDT0001: haven't heard from client 490d3f0d-2f99-4a59-ba28-25cc87930d47 (at 10.240.28.36@tcp) in 34 seconds. I think it's dead, and I am evicting it. exp ff3910b728830c00, cur 1789548443 expire 1789548413 last 1789548409
      [  730.172999] Lustre: lustre-MDT0003: haven't heard from client 490d3f0d-2f99-4a59-ba28-25cc87930d47 (at 10.240.28.36@tcp) in 35 seconds. I think it's dead, and I am evicting it. exp ff3910b72a696c00, cur 1789548448 expire 1789548418 last 1789548413 

      VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV
      sanity-pfl test_2b - Read first component failed

            wc-triage WC Triage
            maloo Maloo
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: