[LU-7578] Push latest gnilnd changes

• Type: Task
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.8.0
• Assignee: Chris Horn
• Reporter: Chris Horn

Description

There have been a few gnilnd changes since the last time we sync'd up. I'll be pushing up the latest commits.

Comments

[Joseph Gmitter (Inactive)]

Patches have landed for 2.8

[James A Simmons]

All outstanding patches have landed.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/17666/
Subject: LU-7578 gnilnd: Return correct error on GNI_RC_ERROR_NOMEM
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 919b8968d84d0d6ad57e2e6e5e1a8ccb02a1bd2c

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/17665/
Subject: LU-7578 gnilnd: Handle new return code in gni_mem_register()
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 37e5f21ee4db9cb3df063d5537511ec15c1196b3

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/17664/
Subject: LU-7578 gnilnd: Add module parameter reg_fail_timeout
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 5b787cb7a375372c7a4f3c405d38137a7a867677

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/17663/
Subject: LU-7578 gnilnd: Modify allocator flags to prevent waiting
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 4e7994f45811e66f50a5d174b1b5dfc20c65269b

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/17667/
Subject: LU-7578 gnilnd: Revert max_immediate setting
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 928c5050f7d2a8a2cabb6eeb3993b29166fdaf1e

[James A Simmons]

Just did another round of testing and I didn't see problems this time. Strange some unrelated change must of landed that fix the problem the latest Gemini changes must of been exposing.

[Chuck Fossen]

James, are you saying that gnilnd is now using more memory or that allocations are failing when the node is under high memory pressure?
Also, I assume this is on compute nodes that you are seeing this issue. Is that true?
I don't see that these changes would cause gnilnd to use more memory.
http://review.whamcloud.com/17663 changed the vmalloc allocation flags so an allocation will fail instead of waiting forever to allocate memory.
We have seen heartbeat failures when a node needs to allocate memory to establish a connection in the case where Lustre is trying to write to disk in order to free memory.

[Chris Horn]

James, I've passed along your comments to our gnilnd engineers and asked them to weigh in on this ticket.