https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-4594 Lustre <p>In lprocfs_mdt_wr_evict_client(), it says evict client by nid not implemented:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> static int lprocfs_mdt_wr_evict_client(struct file *file, const char *buffer, unsigned long count, void *data) { ... if (strncmp(tmpbuf, "nid:", 4) != 0) { count = lprocfs_wr_evict_client(file, buffer, count, data); goto out; } CERROR("NOT implement evict client by nid %s\n", tmpbuf); ... } </pre> </div></div> <p>Is there a reason why evict_client by nid still denied ?</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> if (strncmp(tmpbuf, "nid:", 4) != 0) { </pre> </div></div> <p>As i see above case came from times when evict_by_nid was not supported.</p> LU-4594

evict client by nid not implemented in MDT

Bug Minor Resolved Won't Fix Cliff White Sergey Cheremencev patch Thu, 6 Feb 2014 13:57:41 +0000 Mon, 24 Nov 2014 13:20:36 +0000 Thu, 20 Nov 2014 17:42:03 +0000 Lustre 2.5.0 0 6 <p>I think the functionality still lives in mds code and has not been migrated?</p> <p>Hello Oleg</p> <p>As i see that functionality is available in following places in proc:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>[root@192 tests]# find /proc/fs/lustre/ -name evict_client /proc/fs/lustre/obdfilter/lustre-OST0001/evict_client /proc/fs/lustre/obdfilter/lustre-OST0000/evict_client /proc/fs/lustre/mdt/lustre-MDT0000/evict_client /proc/fs/lustre/mgs/MGS/evict_client </pre> </div></div> <p>I've added a patch with simple test. Hope it will be useful <a href="http://review.whamcloud.com/#/c/9202/" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/#/c/9202/</a></p> <p>The thing with evict client by nid on MDT is such that it must be sending updates to all the servers, not just locally.</p> <p>That was the functionality in 1.x and it needs to be updated to happen in 2.x as well, otherwise we have change in expected behavior. That's why it was disabled on MDT I presume.</p> <p>evict client by uuid does the same things as evict client by nid:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>... class_fail_export(doomed_exp); class_export_put(doomed_exp); </pre> </div></div> <p>As I understand evict client by uuid also doesn't send updates to all servers.<br/> Possible the both functions(evict by nid and by uuid) should be denied or allowed ?</p> <p>Thanks</p> <p>You need t ocheck original b1_8 code:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>static int lprocfs_mds_wr_evict_client(struct file *file, const char *buffer, unsigned long count, void *data) { struct obd_device *obd = data; struct mds_obd *mds = &amp;obd-&gt;u.mds; char tmpbuf[sizeof(struct obd_uuid)]; struct ptlrpc_request_set *set; int rc; sscanf(buffer, "%40s", tmpbuf); if (strncmp(tmpbuf, "nid:", 4) != 0) return lprocfs_wr_evict_client(file, buffer, count, data); set = ptlrpc_prep_set(); if (!set) return -ENOMEM; if (obd-&gt;u.mds.mds_evict_ost_nids) { rc = obd_set_info_async(mds-&gt;mds_lov_exp,sizeof(KEY_EVICT_BY_NID), KEY_EVICT_BY_NID, strlen(tmpbuf + 4) + 1, tmpbuf + 4, set); if (rc) CERROR("Failed to evict nid %s from OSTs: rc %d\n", tmpbuf + 4, rc); ptlrpc_check_set(set); } /* See the comments in function lprocfs_wr_evict_client() * in ptlrpc/lproc_ptlrpc.c for details. - jay */ class_incref(obd); LPROCFS_EXIT(); obd_export_evict_by_nid(obd, tmpbuf+4); rc = ptlrpc_set_wait(set); if (rc) CERROR("Failed to evict nid %s from OSTs: rc %d\n", tmpbuf + 4, rc); LPROCFS_ENTRY(); class_decref(obd); ptlrpc_set_destroy(set); return count; } </pre> </div></div> <p>This is the functionality that needs to be restored.<br/> It might be better to move this to mgs as a more "Central" and logical location too. We'll need to update the documentation and possibly add some compatibility hooks for older code.</p> <p>btw, if you plan to add this, make sure to properly use copy_from_user to avid the bugs present in this code. Thanks.</p> <p>oh, to answer your other question, there's different uuid as seen by every server per client I think, that's why evict by uuid is a totally local operation.</p> <p>Sergey, will you be updating this patch to address Oleg's concerns?</p> <p>Yes, i will update it.</p> <p>Hi, Oleg.<br/> Thanks for your answers.</p> <p>I tried to restore functionality from b1_8 that you mentioned above and faced several problems.<br/> I put this code into mgs/lproc_mgs.c, but mgs self_export doesn't have set_info_async operation </p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>obd-&gt;obd_self_export-&gt;exp_obd-&gt;obd_type-&gt;typ_dt_ops-&gt;o_set_info_async == NULL </pre> </div></div> <p>mdt export has this operation but you suggested to use mgs аs a more "Central" location.</p> <p>Did I miss something ?</p> <p>Sergey - the patch needs to be updated, is it possible for you to do this?</p> <p>I need answers from Oleg to understand how patch should be updated.<br/> In any cases current patch is not suitable. I think it could be abandoned.</p> <p>We have abandoned the patch and are closing this issue. Please reopen if you wish.</p> <p>basically what is needed is this:</p> <p>proc handler that would get the nid list.<br/> then will send set_info async RPCs to MDS and OSTs to relay this information and also communicate this internally too.</p> <p>Whenever you choose to implement MGS side of thins as a set_info handler (with a corresponding implementation) or by some other means is less important, though set_info handler might be better just for uniformity reasons.</p> Development Rank 1|hzwef3: Rank (Obsolete) 12547 Severity