[LU-869] sanity.sh test_81b failed with "dd should fail for -ENOSPC, but succeed"

• Type: Bug
• Resolution: Duplicate
• Priority: Major
• Affects Version/s: Lustre 2.2.0, Lustre 2.1.1, Lustre 2.1.2
• Severity: 3
• Assignee: Niu Yawei (Inactive)
• Reporter: Maloo

Description

This issue was created by maloo for sarah <[e-mail]>

This issue relates to the following test suite run: https://maloo.whamcloud.com/test_sets/d3d44298-114c-11e1-ad46-52540025f9af.
Found similar error in ORI-403

Issue Links

• duplicates: LU-2131 sanity test using ost0 which does not exist.
• is related to: LU-3801 Interop 2.1.5<->2.5 failure on test suite parallel-scale-nfsv3 test_connectathon: can't sync bigfile
• is related to: LU-1228 sanity.sh test_99a failed with "no space left on device"
• Trackbacks: Lustre 2.1.1 release testing tracker Lustre 2.1.1 RC2 Tag: v2110RC2 Build:
• Trackbacks: Lustre 2.1.2 release testing tracker Lustre 2.1.2 RC2 Tag: v212RC2 Build:
• Trackbacks: Lustre 2.2.0 mini release testing tracker Lustre 2.2.0 Mini Release Tag: 2.1.52.0 Build:&nbsp;https://newbuild.whamcloud....
• Trackbacks: Lustre 2.2.0 release testing tracker Lustre 2.2.0 RC1&nbsp; Tag: 2.2.0RC1 Build:&nbsp;https://build.whamcloud.com/job/lustreb22/11/ Google doc:&nbsp;https://docs.google.com/a/whamcloud.com/spreadsheet/ccc?key=0AkK5hBTd2cvHdDFsSWt2RlBocE5kdi03OUYtX21ZYkE#gid=3 Lustre 2.2....

Comments

[Jinshan Xiong (Inactive)]

it looks like this issue can only be seen on suse clients. I don't know what's the difference between rhel and suse clients.

[Sarah Liu]

Got this issue on 2.2-RC1 test, RHEL6 server/SUSE client:
https://maloo.whamcloud.com/test_sets/5c52111e-70f6-11e1-a89e-5254004bbbd3

[Zhenyu Xu]

another hit for 2.2 https://maloo.whamcloud.com/test_sets/9d70bce8-6ed7-11e1-b737-5254004bbbd3

== sanity test 81b: OST should return -ENOSPC when retry still fails ================================= 21:47:12 (1331786832)
fail_loc=0x228
write: Input/output error
 sanity test_81b: @@@@@@ FAIL: dd should fail for -ENOSPC, but succeed. 

[Niu Yawei (Inactive)]

Hi, Andreas, did your tests pass or not?

I tried the tests locally, and they all passed, I think the EIO error messages are what we expected, since these tests are trying to create file after exhausting the precreation, and that should get EIO error from the server. (see qos_prep_create()->alloc_idx_array(), when we fail to create any stripe, -EIO will be returned the client)

[Andreas Dilger]

Niu, could you please run this test locally to try and debug it. I'm repeatedly seeing IO errors running sanity.sh test_27[opqv] during file object creations running on a RHEL6 kernel.

[Niu Yawei (Inactive)]

Thanks, Sarah. The log shows that AS_ENOSPC was set on the proper i_mapping, and I can't tell why it's not transfered to -ENOSPCE in wait_on_page_writeback_range() from the kernel code.

[Sarah Liu]

https://maloo.whamcloud.com/test_sets/6e7dd01e-599d-11e1-a26b-5254004bbbd3

For server log please the attached.

[Niu Yawei (Inactive)]

ok, I uploaded the diagnostic patch in the patchset 2 of http://review.whamcloud.com/#change,1748

[Sarah Liu]

Hi Niu, could you please just submit the patch to review and tell me the build number?

Thanks.

[Niu Yawei (Inactive)]

Hi Niu, do you mean this patch? http://review.whamcloud.com/#change,1748

I meant the patch attached here: LU-869-debug.patch.

[Sarah Liu]

Hi, Sarah
Could you apply this debug patch to client and repeat the test with D_TRACE & D_PAGE enabled?

Hi Niu, do you mean this patch? http://review.whamcloud.com/#change,1748