https://jira.whamcloud.com This file is an XML representation of an issue en-us 9.4.14 940014 05-12-2023 https://jira.whamcloud.com/browse/LU-2979 Lustre <p>This issue was created by maloo for Li Wei &lt;liwei@whamcloud.com&gt;</p> <p>This issue relates to the following test suite run: <a href="https://maloo.whamcloud.com/test_sets/9b412d48-8dbe-11e2-bb99-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/9b412d48-8dbe-11e2-bb99-52540035b04c</a>.</p> <p>The sub-test test_133a failed with the following error:</p> <blockquote> <p>The counter for mkdir on mds1 was not incremented</p></blockquote> <p>Info required for matching: sanity 133a</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>== sanity test 133a: Verifying MDT stats ========================================== 09:55:50 (1363366550) CMD: client-20-ib /usr/sbin/lctl list_param mdt.*.rename_stats mdt.lustre-MDT0000.rename_stats CMD: client-20-ib /usr/sbin/lctl set_param mdt.*.md_stats=clear mdt.lustre-MDT0000.md_stats=clear CMD: client-21-ib /usr/sbin/lctl set_param obdfilter.*.stats=clear obdfilter.lustre-OST0000.stats=clear obdfilter.lustre-OST0001.stats=clear obdfilter.lustre-OST0002.stats=clear obdfilter.lustre-OST0003.stats=clear obdfilter.lustre-OST0004.stats=clear obdfilter.lustre-OST0005.stats=clear obdfilter.lustre-OST0006.stats=clear CMD: client-20-ib /usr/sbin/lctl get_param mdt.lustre-MDT0000.md_stats sanity test_133a: @@@@@@ FAIL: The counter for mkdir on mds1 was not incremented Trace dump: = /usr/lib64/lustre/tests/test-framework.sh:3973:error_noexit() = /usr/lib64/lustre/tests/test-framework.sh:3996:error() = /usr/lib64/lustre/tests/sanity.sh:8033:check_stats() = /usr/lib64/lustre/tests/sanity.sh:8056:test_133a() = /usr/lib64/lustre/tests/test-framework.sh:4251:run_one() = /usr/lib64/lustre/tests/test-framework.sh:4284:run_one_logged() = /usr/lib64/lustre/tests/test-framework.sh:4139:run_test() = /usr/lib64/lustre/tests/sanity.sh:8083:main() Dumping lctl log to /logdir/test_logs/2013-03-15/lustre-reviews-el6-x86_64--review--1_2_1__14053__-70011914322200-085246/sanity.test_133a.*.1363366552.log CMD: client-20-ib,client-21-ib,client-22-ib,client-23-ib.lab.whamcloud.com /usr/sbin/lctl dk &gt; /logdir/test_logs/2013-03-15/lustre-reviews-el6-x86_64--review--1_2_1__14053__-70011914322200-085246/sanity.test_133a.debug_log.\$(hostname -s).1363366552.log; dmesg &gt; /logdir/test_logs/2013-03-15/lustre-reviews-el6-x86_64--review--1_2_1__14053__-70011914322200-085246/sanity.test_133a.dmesg.\$(hostname -s).1363366552.log </pre> </div></div> LU-2979

sanity 133a: proc counter for mkdir on mds1 was not incremented

Bug Blocker Closed Won't Fix Di Wang Maloo LB Mon, 18 Mar 2013 06:42:37 +0000 Sun, 14 Aug 2016 17:23:33 +0000 Sun, 14 Aug 2016 17:23:33 +0000 Lustre 2.4.0 Lustre 2.4.0 0 8 <p>Di,<br/> Could you have a quick look at this one and give your opinion on the severity?<br/> Thank you!</p> <p>Jodi, minor is fine to me, IMHO, it is probably test script or counter tracking problem, which does not impact the "real" function.</p> <p>another instance seen in interop between 2.3.0 client and 2.4 server:<br/> <a href="https://maloo.whamcloud.com/test_sets/491428e6-8fed-11e2-9b28-52540035b04c" class="external-link" target="_blank" rel="nofollow noopener">https://maloo.whamcloud.com/test_sets/491428e6-8fed-11e2-9b28-52540035b04c</a></p> <p><a href="http://review.whamcloud.com/6136" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/6136</a> Add some debug information for the failure to help me understand the problem.</p> <p>IMHO, not having properly functioning performance counters is pretty major problem.</p> <p>I believe this is a bug related to on demand allocation of per-cpu stats. If nothing has yet happened on cpu 0 then no stats will have been allocated for cpu 0, and hence lprocfs_stats_counter_get(stats, 0, index) will return NULL. This NULL will in turn be returned from lprocfs_stats_seq_start() and will be interpreted by the seq_file code as an early EOF.</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>static inline struct lprocfs_counter * lprocfs_stats_counter_get(struct lprocfs_stats *stats, unsigned int cpuid, int index) { struct lprocfs_counter *cntr; cntr = &amp;stats-&gt;ls_percpu[cpuid]-&gt;lp_cntr[index]; if ((stats-&gt;ls_flags &amp; LPROCFS_STATS_FLAG_IRQ_SAFE) != 0) cntr = (void *)cntr + index * sizeof(__s64); return cntr; } static void *lprocfs_stats_seq_start(struct seq_file *p, loff_t *pos) { struct lprocfs_stats *stats = p-&gt;private; /* return 1st cpu location */ return (*pos &gt;= stats-&gt;ls_num) ? NULL : lprocfs_stats_counter_get(stats, 0, *pos); } </pre> </div></div> <p>Ah, quite possible, I spent so much time to investigate the problem on collecting, but did not notice listing. Thank you.</p> <p>Please see <a href="http://review.whamcloud.com/6328" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/6328</a>.</p> <p>Patch landed to master</p> <p>verified with the latest tag-2.4.50RC1, client is running tag-2.4.50RC1 and server is running 2.3.0</p> <p><a href="http://review.whamcloud.com/6136" class="external-link" target="_blank" rel="nofollow noopener">http://review.whamcloud.com/6136</a> is still not landed</p> <p>Old blocker for unsupported version</p> Duplicate LU-3296 Related LU-1282 LU-2902 Development Rank 1|hzvlkn: Rank (Obsolete) 7262 Severity