Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-20981

ost_io and mdt_io threads ignore cpu_pattern CPT exclusions on single-CPT multi-NUMA hosts

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Medium Medium
    • Lustre 2.18.0
    • None
    • None
    • 3
    • 9223372036854775807

      LU-17501 added X[...]/C[...] forms to cpu_pattern so selected cores can be excluded from Lustre's CPT table. The ost_io and mdt_io services don't honour that exclusion in one case: when the host has a single CPT and more than one NUMA node.

      In that case ofd_oss.c and mdt_mds.c build a per-NUMA-node CPT table for the io services using cfs_cpt_set_node(). That call adds every core of the node, including cores that cpu_pattern removed. The excluded cores come back, and the io threads run on them.

      Reproducer:
      1. On a host with 2 or more NUMA nodes, load libcfs with a cpu_pattern that gives one CPT and excludes one core. For example, cpu_pattern="N X[<cpu>]".
      2. Start an OSS or MDS.
      3. Check Cpus_allowed_list in /proc/<pid>/status for the ll_ost_io and mdt_io threads. It includes the excluded CPU.

            mdiep Minh Diep - TLC
            mdiep Minh Diep - TLC
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: