https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-9180 Lustre <p>I tried to set a map_on_demand = 32 (default for OPA) with an upstream Lustre build and run it on an MLX QDR set of system.  When I tried a bulk lnet-selftest test, it failed with this log:</p> <p>[ 1125.547100] LNetError: 22552:0:(o2iblnd_cb.c:1068:kiblnd_init_rdma()) RDMA is too large for peer 192.168.1.24@o2ib (131072), src size: 1048576 dst size: 1048576</p> <p>When I went back to a much older upstream build, 4.8rc2, the same test worked.  So, some porting from master to upstream seems to have not worked.  The same test works fine on master.</p> LU-9180

Upstream ko2iblnd does not work with map_on_demand <256

Bug Critical Resolved Fixed WC Triage Doug Oucharek lnet Sat, 4 Mar 2017 06:17:06 +0000 Sat, 3 Nov 2018 18:38:04 +0000 Sat, 3 Nov 2018 18:38:04 +0000 Upstream 0 8 <p>Strange it should work. The patch for <a href="https://jira.whamcloud.com/browse/LU-7650" title="ko2iblnd map_on_demand can&#39;t negotitate when page sizes are different between nodes." class="issue-link" data-issue-key="LU-7650"><del>LU-7650</del></a> was never revverted upstream. Instead I expected that once a proper solution for <a href="https://jira.whamcloud.com/browse/LU-7650" title="ko2iblnd map_on_demand can&#39;t negotitate when page sizes are different between nodes." class="issue-link" data-issue-key="LU-7650"><del>LU-7650</del></a> was done the fix could be pushed upstream instead.</p> <p>It looks this is common issue. I reopened <a href="https://jira.whamcloud.com/browse/LU-5718" title="RDMA too fragmented with router" class="issue-link" data-issue-key="LU-5718"><del>LU-5718</del></a> because of I got this error with latest master build after patch "<a href="https://jira.whamcloud.com/browse/LU-5718" title="RDMA too fragmented with router" class="issue-link" data-issue-key="LU-5718"><del>LU-5718</del></a> o2iblnd: multiple sges for work request" landed.</p> <p> </p> <p>Dmitry,<br/> Failure introduced in master by <a href="https://jira.whamcloud.com/browse/LU-5718" title="RDMA too fragmented with router" class="issue-link" data-issue-key="LU-5718"><del>LU-5718</del></a> fix may have been fixed by <a href="https://jira.whamcloud.com/browse/LU-9420" title="Bad Check slipped into repo" class="issue-link" data-issue-key="LU-9420"><del>LU-9420</del></a>, just landed. Maybe you should retry on latest master.</p> <p>This ticket is about upstream staging and not master.  Upstream has it's own set of problems.</p> <p>This was due to left overs from <a href="https://jira.whamcloud.com/browse/LU-7650" title="ko2iblnd map_on_demand can&#39;t negotitate when page sizes are different between nodes." class="issue-link" data-issue-key="LU-7650"><del>LU-7650</del></a> which was incorrect. All the code has been removed upstream and replaced with what landed during 2.11 development cycle.</p> Related LU-9679 Development Rank 1|hzz5tr: Rank (Obsolete) 9223372036854775807 Severity