Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-20582

statahead: multithreaded FNAME detection bypasses validation checks

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Medium Medium
    • None
    • None
    • None
    • 3
    • 9223372036854775807

      FNAME pattern detection is supposed to check the following:

      1. if the name end with number
      2. if the numbers are consecutive between each stat process
      3. if the match count > lli_sa_match_count (statahead_fname_match_hit parameter)

      All of this are ignored if the directory is accessed by multiple processes running stats with names ended by a number:

      Reproducer:

      [root@client-el8 lustre]# seq 1 10 1000 | xargs -P 100 -I{} stat testdir/testfile{} > /dev/null;
      pgrep ll_sa                                                                                     
      733210                                                                                          
      733211                                                                                          
      733212                                                                                          
      733213                                                                                          
      733222                                                                                          
      733223                                                                                          
      733226                                                                                          
      733230                                                                                          
      733231                                                                                          
      733234                                                                                          
      733237                                                                                          
      733241                                                                                          
      733245                                                                                          
      733248                                                                                          
      733250                                                                                          
      733254                                                                                          
      

      Each stat process is accessing to only one entry making statahead inefficient. And each statahead process will timeout after 30s for a stat during several ms.

            qian_wc Qian Yingjin
            eaujames Etienne Aujames
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: