[LU-7899] osd_xattr_set() to batch actual EA update

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.10.1, Lustre 2.11.0
• Assignee: Alex Zhuravlev
• Reporter: Alex Zhuravlev

Description

moving EAs from nvlist into bonus/spill is quite expensive, we can save on this a bit collecting changes in nvlist (what we do already) and calling sa_update() from osd_trans_stop().

Issue Links

• is blocking: LU-7895 zfs metadata performance improvements
• is related to: LU-8449 OSS crash with oom-killer started

Comments

[Gerrit Updater]

John L. Hammond ([e-mail]) merged in patch https://review.whamcloud.com/28482/
Subject: LU-7899 osd: batch EA updates
Project: fs/lustre-release
Branch: b2_10
Current Patch Set:
Commit: d53a1183058ebfd52bf61b194d151369ba7c5087

[Gerrit Updater]

Minh Diep ([e-mail]) uploaded a new patch: https://review.whamcloud.com/28482
Subject: LU-7899 osd: batch EA updates
Project: fs/lustre-release
Branch: b2_10
Current Patch Set: 1
Commit: 214a6c3d66456ff5f73fce8eb06b0b8e164347f7

[Peter Jones]

Landed for 2.11

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/21893/
Subject: LU-7899 osd: batch EA updates
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2c9ff6dffdf4320af95c9db9af07a416529275f0

[Cliff White (Inactive)]

Tested latest version of the patch, ran 24 hours on soak, so far. No significant errors.

[Cliff White (Inactive)]

What are you looking for from slab top? No hard crashes yet, restarting this morning.

[Alex Zhuravlev]

Cliff, any more details?

[Cliff White (Inactive)]

With this patch, i am seeing more jobs fail than succeed.

[Cliff White (Inactive)]

I am seeing more odd job failures. Things like:

07/21/2017 19:10:37: Process 0(soak-16.spirit.hpdd.intel.com): FAILED in mdtest_stat, unable to stat file: Input/output error
34395-simul.out:19:32:08: Process 10(soak-26.spirit.hpdd.intel.com): FAILED in simul_file_stat, stat failed: Input/output error
34409-simul.out:19:31:50: Process 12(soak-26.spirit.hpdd.intel.com): FAILED in simul_truncate, truncate failed: Cannot send after transport endpoint shutdown
34442-simul.out:19:10:37: Process 0(soak-16.spirit.hpdd.intel.com): FAILED in create_files, write in file /mnt/soaked/soaktest/test/simul/34442/simul_write.12: Input/output error
34454-mdtestssf.out:07/21/2017 19:10:37: Process 0(soak-16.spirit.hpdd.intel.com): FAILED in mdtest_stat, unable to stat file: Input/output error
34454-mdtestssf.out:07/21/2017 19:10:37: Process 1(soak-16.spirit.hpdd.intel.com): FAILED in mdtest_stat, unable to stat file: Input/output error
34462-simul.out:19:25:28: Process 26(soak-29.spirit.hpdd.intel.com): FAILED in simul_truncate, truncate failed: Input/output error

investigating.

[Alex Zhuravlev]

Cliff, the patch has been rebased. please, give it a run. thanks in advance.