[LU-6101] sanity test_24A: Can not delete directories

• Type: Bug
• Resolution: Fixed
• Priority: Critical
• Fix Version/s: Lustre 2.7.0
• Affects Version/s: Lustre 2.7.0
• Labels: HB zfs
• Severity: 3
• Assignee: Nathaniel Clark
• Reporter: Maloo

Description

This issue was created by maloo for nasf <[e-mail]>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/60ca627c-97d7-11e4-ba89-5254006e85c2.

The sub-test test_24A failed with the following error:

Can not delete directories

Please provide additional information about the failure here.

Info required for matching: sanity 24A

Issue Links

• is related to: LU-5765 sanity test_123a test_123b: rm: no such file or directory
• is related to: LU-3573 lustre-rsync-test test_8: @@@@@@ FAIL: Failure in replication; differences found.

Comments

[Jodi Levi (Inactive)]

Patch landed to Master.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/13340/
Subject: LU-6101 osd: zfs-osd should convert hash
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 558a3a4a060fc4eaeff8c86c3719e2f4a047a07d

[Jian Yu]

More instance on master branch:
https://testing.hpdd.intel.com/test_sets/073c86e8-9c48-11e4-afb8-5254006e85c2

[Gerrit Updater]

Alex Zhuravlev ([e-mail]) uploaded a new patch: http://review.whamcloud.com/13340
Subject: LU-6101 osd: zfs-osd should convert hash
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 361b32d96678a8c0eed090aff749f00853d952f7

[Alex Zhuravlev]

not sure this is related, but I started to get this problem quite often:

• created 10000 (time 1420674282.55 total 15.16 last 15.16)
• created 20000 (time 1420674296.81 total 29.42 last 14.26)
• created 30000 (time 1420674312.91 total 45.53 last 16.10)
• created 40000 (time 1420674328.02 total 60.63 last 15.11)
  total: 50000 creates in 78.00 seconds: 641.06 creates/second
  rm: cannot remove `/mnt/lustre/d505.sanity': Directory not empty

this is a simple sequence of createmany && rm -rf, with 10-40K files it's impossible to reproduce (on my setup).

[Andreas Dilger]

Linking to LU-3573, since it seems at least potentially related. It looks like all of the failures, except for one back in October, are on review-zfs.

[nasf (Inactive)]

Many failure instance recently:
https://testing.hpdd.intel.com/sub_tests/699d14e4-97d7-11e4-ba89-5254006e85c2
https://testing.hpdd.intel.com/sub_tests/97fc7cac-9760-11e4-bafa-5254006e85c2
https://testing.hpdd.intel.com/sub_tests/c1e46b3a-95a1-11e4-8cd1-5254006e85c2
https://testing.hpdd.intel.com/sub_tests/dee68b9c-6a44-11e4-9c96-5254006e85c2
https://testing.hpdd.intel.com/sub_tests/70caaa4e-631e-11e4-8a7a-5254006e85c2
https://testing.hpdd.intel.com/test_sets/74733cbe-4dad-11e4-857c-5254006e85c2